-- Logs begin at Fri 2022-08-19 15:33:03 UTC, end at Fri 2022-08-19 16:51:18 UTC. -- Aug 19 16:23:07.778481 dv-cinder-831247-23-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 19 16:23:07.787112 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 19 16:23:07.789307 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 19 16:23:07 2022] *** Aug 19 16:23:07.789307 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 16:23:07.789307 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 16:23:07.789307 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: nodename: dv-cinder-831247-23-iscsi Aug 19 16:23:07.789307 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: machine: x86_64 Aug 19 16:23:07.789307 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: clock source: unix Aug 19 16:23:07.789307 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: pcre jit disabled Aug 19 16:23:07.789307 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: detected number of CPU cores: 4 Aug 19 16:23:07.789307 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: current working directory: / Aug 19 16:23:07.789307 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: detected binary path: /usr/bin/uwsgi-core Aug 19 16:23:07.790014 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: your processes number limit is 47680 Aug 19 16:23:07.790014 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: your memory page size is 4096 bytes Aug 19 16:23:07.790014 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: detected max file descriptor number: 2048 Aug 19 16:23:07.790014 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: lock engine: pthread robust mutexes Aug 19 16:23:07.790014 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: thunder lock: enabled Aug 19 16:23:07.790014 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 19 16:23:07.790014 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 19 16:23:07.828835 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: Python main interpreter initialized at 0x55db389939c0 Aug 19 16:23:07.828835 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: python threads support enabled Aug 19 16:23:07.828835 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: your server socket listen backlog is limited to 100 connections Aug 19 16:23:07.828835 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: your mercy for graceful operations on workers is 90 seconds Aug 19 16:23:07.829159 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 16:23:07.829242 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: *** Operational MODE: preforking *** Aug 19 16:23:07.829483 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: *** uWSGI is running in multiple interpreter mode *** Aug 19 16:23:07.829483 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: spawned uWSGI master process (pid: 105530) Aug 19 16:23:07.829680 dv-cinder-831247-23-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 19 16:23:07.830201 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: spawned uWSGI worker 1 (pid: 105531, cores: 1) Aug 19 16:23:07.832789 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: spawned uWSGI worker 2 (pid: 105532, cores: 1) Aug 19 16:23:07.832789 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 16:23:08.491870 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 19 16:23:08.499133 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 19 16:23:09.570506 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 16:23:09.570506 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: from cryptography.utils import int_from_bytes Aug 19 16:23:09.571095 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 16:23:09.571095 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: from cryptography.utils import int_from_bytes Aug 19 16:23:09.594943 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 16:23:09.594943 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: from cryptography.utils import int_from_bytes Aug 19 16:23:09.595388 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 16:23:09.595388 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: from cryptography.utils import int_from_bytes Aug 19 16:23:12.029241 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 16:23:12.029795 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 16:23:12.030006 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 16:23:12.030369 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 16:23:12.030626 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 16:23:12.031014 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.031339 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.031663 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.031985 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.032313 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.032621 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.032971 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.033301 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.033627 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.033889 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.034203 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.034525 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-23-iscsi {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.034846 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.035153 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.035376 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 16:23:12.035732 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.035830 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 16:23:12.035914 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.036055 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.036148 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 16:23:12.036376 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.037069 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 16:23:12.037268 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.037532 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 16:23:12.037762 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.038044 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.038175 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.038384 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.038499 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.038717 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.038837 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.039071 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.039248 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.039387 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.039510 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.039691 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.039822 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.040012 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.040152 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.040319 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.040452 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.040641 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.040788 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.040931 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.041069 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.041255 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.041381 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-23-iscsi {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.041586 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-23-iscsi {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.041724 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.041915 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.042050 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.042226 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.042353 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.042545 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.042678 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.042876 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.043019 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.043190 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.043298 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.043517 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.043613 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.043826 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.043911 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.044139 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.044335 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.044455 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.044646 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.044785 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.044983 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.045086 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.045300 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.045392 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.045640 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.045725 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.045959 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.046057 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.046265 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.046356 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.046584 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.046679 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.046884 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.046971 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.047186 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.047271 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.047437 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.047519 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.047743 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.047890 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-23-iscsi {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.048062 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.048209 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.048380 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.048525 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.048699 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.048875 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.048961 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.049212 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.049299 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.049529 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.049615 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.049847 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.049943 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.050154 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.050239 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.050462 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.050558 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.050769 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.050868 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.051075 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.051160 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.051381 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.051467 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.051686 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.051780 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.051991 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.052093 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.052498 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.052592 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.052954 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.053058 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.053382 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.053468 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.053707 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.053799 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.054013 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.054106 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.054328 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.054431 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.054583 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.054713 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.054896 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.054983 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.055224 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.055308 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.055549 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.055633 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.055875 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.055963 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.056132 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.056219 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.056387 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.056481 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.056710 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.056821 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.057075 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.057162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.057390 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.057483 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.057695 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.057790 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.058000 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.058083 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.058311 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.058406 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.058612 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.058705 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.058863 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.058948 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.059162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.059249 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.059466 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.059550 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.059784 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.059868 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.060090 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.060176 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.060397 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.060483 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.060702 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.060827 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.061031 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.061119 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.061336 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.061451 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.061641 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.061727 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.061946 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.062039 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.062251 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.062345 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.062556 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.062641 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.062857 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.062943 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.063162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.063254 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.063469 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.063640 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.063771 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.063857 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.064085 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.064171 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.064404 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.064510 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.064706 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.064822 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.065035 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.065119 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.065340 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.065435 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.065610 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.065695 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.065917 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.066001 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.066229 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.066325 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.066529 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.066614 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.066846 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.066939 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.067145 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.067238 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.067446 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.067531 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.067776 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.067883 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.068149 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.068352 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.068454 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.068681 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.068794 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.069038 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.069136 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.069347 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.069438 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.069659 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.069752 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.069963 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.070061 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.070266 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.070365 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.070570 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.070672 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.070870 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.070972 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.071170 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.071255 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.071471 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.071557 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.071772 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.071872 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.072072 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.072158 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.072366 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.072450 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.072681 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.072830 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.073023 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.073115 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.073328 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.073413 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.073634 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.073727 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.073935 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.074020 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.074249 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.074334 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.074555 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.074640 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.074880 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.074965 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.075194 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.075280 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.075506 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.075591 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.075829 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.075913 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.076135 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.076227 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.076448 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.076544 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.076770 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.076857 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.077087 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.077182 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.077394 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.077478 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.077702 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.077803 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.078010 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.078153 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.078317 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.078402 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.078627 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.078711 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.078930 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.079021 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.079240 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.079332 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.079549 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.079634 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.079858 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.079953 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.080174 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.080260 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.080481 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.080569 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.080810 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.080910 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.081131 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.081214 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.081445 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.081528 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:23:12.081754 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.081840 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.082089 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.082173 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.082427 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.082513 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.082736 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.082834 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.083058 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.083143 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.083898 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.083997 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.084213 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.084523 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.084652 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.084856 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.084945 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.085177 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.085340 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.085505 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.085591 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.085816 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.085901 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.086134 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.086228 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.086445 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.086531 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.086756 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.086850 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.087064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.087158 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.087375 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.087464 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.087685 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.087777 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.088019 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.088112 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.088331 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.088419 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.088644 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.088728 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.088979 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.089074 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.089295 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.089388 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.089606 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.089691 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.089918 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.090009 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.090224 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.090572 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.090792 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.090878 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.091097 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.091196 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.091399 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.091492 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.091708 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.091803 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.092009 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.092095 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.092325 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.092410 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.092648 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.092799 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.092981 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.093066 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.093311 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.093399 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.093616 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.093710 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.093932 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.094017 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.094242 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.094335 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.094550 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.094644 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.094854 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.094942 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.095166 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.095260 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.095472 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.095567 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.095774 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.095860 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.096094 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.096179 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.096401 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.096487 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.096702 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.096806 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.097049 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.097144 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.097355 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.097441 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.097657 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.097742 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.097968 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.098054 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.098279 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.098366 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.098587 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.098672 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.098897 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.099028 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.099840 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.100010 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.100166 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.100482 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.100566 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.100824 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.100914 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.101162 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.101246 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.101483 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.101578 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.101783 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.101868 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.102108 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.102193 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.102428 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.102518 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.102739 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.102824 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.103043 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.103127 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.103354 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.103446 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.103653 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.103736 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.103961 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.104045 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.104264 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.104365 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.104572 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.104657 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.104899 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.104998 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.105206 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.105300 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.105509 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.105601 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.105814 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.105899 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.106117 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.106215 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.106431 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.106522 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.106737 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.106820 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.107041 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.107127 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.107346 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.107438 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.107646 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.107744 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.107975 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.108067 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.108275 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.108366 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.108600 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.108690 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.108955 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.109053 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.109274 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.109359 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.109583 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.109667 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.109892 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.109978 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.110206 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.110291 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.110518 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.110612 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.110830 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.110916 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.111141 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.111225 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.111448 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.111540 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.111760 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.111845 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.112067 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.112161 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.112378 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.112471 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.112684 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.112831 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.113018 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.113101 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.113327 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.113424 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.113632 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.113716 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.113940 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.114025 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.114252 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.114346 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.114612 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.114714 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.114944 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.115175 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.115337 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.115527 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.115624 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.115845 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.115930 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.116160 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.116259 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.116470 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.116555 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.116804 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.116916 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.117118 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.117233 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.117436 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.117529 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.117748 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.117839 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.118058 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.118160 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.118374 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.118480 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.118688 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.118784 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.119008 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.119107 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.119316 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.119407 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.119634 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.119731 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.119938 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.120028 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.120250 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.120339 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.120573 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.120663 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.120910 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.121001 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.121222 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.121311 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.121535 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.121625 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.121856 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.121947 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.122164 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.122281 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.122469 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.122572 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.122779 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.122870 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.123082 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.123179 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.123385 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.123527 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.123699 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.123783 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.124015 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.124106 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.124325 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.124438 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.124632 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.124721 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.124959 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.125088 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.125272 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.125380 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.125577 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.125663 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.125879 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.125971 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.126180 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.126275 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.126490 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.126611 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.126812 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.126896 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.127116 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.127201 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.127437 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.127522 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.127756 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.127848 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.128059 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.128145 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.128363 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.128448 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.128684 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.128832 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.129019 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.129107 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.129321 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.129414 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.129624 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.129709 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.129925 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.130021 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.130300 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.130453 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.130604 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.130907 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.131002 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.131222 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.131359 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.131541 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.131678 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.131850 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.131994 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.132160 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.132360 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.132467 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.132687 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.132837 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.133035 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.133158 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.133354 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.133469 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.133668 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.133763 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.133991 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.134078 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.134308 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.134435 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.134621 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.134708 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.134931 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.135023 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.135249 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.135335 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.135558 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.135643 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.135868 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.135953 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.136177 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.136270 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.136480 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.136575 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.136810 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.136902 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.137124 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.137208 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.137455 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.137683 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.137768 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.138014 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.138099 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.138329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.138416 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.138647 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.138732 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.138967 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.139059 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.139286 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.139374 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.139593 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.139683 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.139918 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.140004 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.140251 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.140337 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.140552 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.140646 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.140883 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.140973 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.141192 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.141290 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.141498 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.141591 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.141810 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.141896 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.142118 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.142280 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.142423 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.142568 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.142728 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.142814 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.143035 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.143132 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.143340 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.143427 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.143645 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.143730 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.143953 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.144042 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.144256 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.144342 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.144570 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.144653 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.144891 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.144994 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.145204 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.145330 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.145509 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.145595 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.146344 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.146486 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.146647 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.146949 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.147218 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.147313 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.147538 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.147624 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.147875 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.147959 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.148177 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.148271 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.148510 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.148597 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.148857 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.148999 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.149195 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.149293 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.149495 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.149581 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.149799 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.149885 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.150122 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.150218 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.150426 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.150513 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.150728 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.150812 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.151031 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.151117 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.151342 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.151429 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.151649 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.151743 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.151949 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.152034 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.152257 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.152352 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.152566 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.152697 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.152897 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.153002 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.153203 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.153288 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.153506 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.153593 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.153812 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.153905 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.154109 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.154195 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.154425 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.154526 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.154732 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.154830 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.155030 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.155116 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.155329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.155459 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.155638 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.155735 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.155943 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.156030 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.156241 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.156326 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.156546 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.156632 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.156870 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.156959 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.157186 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.157284 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.157490 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.157578 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.157790 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.157875 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.158091 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.158176 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.158398 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.158486 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.158702 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.158794 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.159001 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.159095 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.159320 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.159407 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.159628 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.159713 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.159930 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.160024 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.160230 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.160323 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.160537 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.160623 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.160858 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.160960 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.161162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.161255 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.162063 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.162159 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.162424 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.162575 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.162739 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.162953 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.163045 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.163269 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.163361 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.163591 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.163677 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.163903 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.163995 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.164200 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.164299 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.164512 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.164598 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.164835 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.164925 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.165139 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.165235 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.165439 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.165572 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.165739 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.165826 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.166039 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.166135 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.166350 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.166434 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.166652 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.166744 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.166952 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.167047 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.167253 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.167339 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.167552 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.167637 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.167858 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.167943 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.168178 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.168270 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.168495 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.168646 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.168832 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.168933 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.169145 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.169230 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.169461 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.169546 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.169767 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.169866 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.170073 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.170166 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.170385 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.170469 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.170683 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.170777 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.170994 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.171079 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.171298 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.171392 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.171608 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.171694 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.171910 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.172004 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.172212 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.172306 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.172524 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.172615 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.172853 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.172942 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.173162 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.173259 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.173473 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.173570 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.173787 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.173881 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.174093 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.174190 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.174394 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.174479 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.174697 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.174781 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.175003 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.175089 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.175305 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.175395 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.175609 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.175702 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.175915 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.176002 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.176221 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.176318 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.176526 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.176611 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.176852 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.176939 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.177187 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.177360 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.177497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.177802 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.177940 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.178110 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.178294 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.178416 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.178611 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.178711 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.178936 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.179021 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.179266 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.179350 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.179590 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.179683 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.179892 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.179976 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.180192 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.180290 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.180500 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.180599 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.180823 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.180912 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.181167 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.181251 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.181489 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.181588 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.181801 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.181887 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.182113 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.182197 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.182419 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.182511 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.182728 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.182814 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.183043 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.183128 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.183354 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.183440 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.183655 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.183740 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.183992 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.184075 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.184304 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.184389 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.184620 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.184704 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.184965 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.185064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.185268 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.185354 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.185572 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.185664 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.185881 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.185966 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.186200 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.186285 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.186503 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.186587 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.186804 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.186902 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.187105 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.187199 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.187421 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.187506 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.187720 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.187813 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.188035 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.188119 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.188351 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.188435 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.188661 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.188793 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.189016 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.189113 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.189334 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.189441 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.189644 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.189752 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.189959 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.190046 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.190270 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.190356 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.190596 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.190682 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.190907 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.190992 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.191253 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.191338 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.191562 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.191656 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.191870 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.191962 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.192191 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.192276 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.192510 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.192597 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.192872 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.192974 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.193184 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.193487 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.193582 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.193806 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.193897 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.194117 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.194201 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.194431 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.194527 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.194752 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.194838 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.195152 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.195236 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.195467 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.195561 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.195775 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.195867 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.196087 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.196172 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.196404 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.196497 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.196707 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.196824 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.197050 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.197136 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.197360 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.197445 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.197662 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.197750 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.197963 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.198049 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.198281 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.198364 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.198578 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.198665 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.198888 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.199013 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.199199 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.199335 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.199507 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.199649 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.199794 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.200071 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.200158 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.200390 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.200477 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.200689 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.200856 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.201047 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.201135 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.201359 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.201446 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.201677 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.201763 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.201989 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.202073 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.202290 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.202384 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.202607 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.202701 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.202914 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.203013 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.203216 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.203303 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.203519 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.203614 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.203824 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.203919 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.204140 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.204462 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.204462 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.204693 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.204803 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.204900 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.205109 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.205194 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.205431 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.205524 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.205740 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.205840 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.206072 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.206170 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.206394 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.206481 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.206710 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.206798 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.207025 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.207112 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.207346 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.207432 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.207648 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.207735 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.207947 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.208032 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.208792 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.208888 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.209086 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.209352 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.209589 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.209679 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.209757 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.209964 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.210068 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.210262 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.210349 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.210563 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.210649 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.210863 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.210958 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.211182 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.211269 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.211482 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.211567 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.211799 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.211886 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.212105 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.212190 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.212405 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.212498 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.212705 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.212812 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.213044 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.213129 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.213381 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.213479 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.213681 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.213769 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.214005 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.214090 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.214315 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.214410 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.214619 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.214703 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.214933 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.215018 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.215486 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.215586 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.215805 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.215892 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.216118 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.216211 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.216431 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.216526 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.216742 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.216898 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.217110 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.217208 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.217418 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.217620 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.217718 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.217799 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.218025 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.218118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.218339 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.218433 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.218723 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.218854 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.219053 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.219181 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.219367 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.219494 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.219680 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.219807 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.220001 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.220118 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.220313 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.220429 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.220626 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.220742 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.220967 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.221086 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.221284 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.221396 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.221594 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.221706 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.221905 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.221999 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.222214 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.222326 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.222540 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.222645 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.222851 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.222968 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.223178 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.223303 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.223494 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.223615 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.223804 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.224602 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.224953 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.225046 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.225263 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.225349 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.225619 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.225712 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.225934 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.226029 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.226243 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.226334 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.226557 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.226645 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.226870 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.226956 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.227181 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.227281 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.227491 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.227577 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.227803 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.227888 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.228115 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.228209 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.228427 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.228514 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.228735 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.228862 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.229064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.229167 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.229373 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.229459 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.229684 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.229818 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.230007 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.230168 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.230337 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.230477 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.230655 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.230873 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.230969 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.231218 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.231306 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.231543 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.231628 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.231866 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.232057 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.232188 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.232374 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.232509 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.232706 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.232856 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.233057 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.233179 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.233380 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.233509 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.233694 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.233790 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.234010 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.234096 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.234336 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.234422 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.234642 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.234736 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.234953 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.235048 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.235265 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.235375 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.235573 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.235700 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.235876 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.236022 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.236196 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.236345 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.236506 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.236667 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.236831 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.237053 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.237152 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.237377 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.237476 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.237693 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.237953 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.238039 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.238293 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.238380 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.238607 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.238701 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.238925 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.239009 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.239242 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.239335 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.239591 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.239687 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.239893 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.240163 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.240326 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.240505 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.240636 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.240853 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.240956 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.241187 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.241274 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.241515 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.241602 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.241850 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.241934 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.242154 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.242248 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.242464 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.242551 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.242774 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.242862 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.243076 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.243170 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.243385 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.243472 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.243690 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.243934 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.244019 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.244257 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.244344 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.244588 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.244672 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.244920 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.245010 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.245233 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.245321 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.245538 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.245668 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.245841 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.245940 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.246143 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.246230 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.246446 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.246534 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.246752 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.246848 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.247053 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.247145 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.247360 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.247445 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.247662 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.247756 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.247971 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.248059 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.248272 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.248358 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.248579 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.248672 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.248899 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.248998 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.249220 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.249307 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.249522 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.249759 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.249872 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.250112 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.250207 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.250434 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.250528 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.250767 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.250853 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.251077 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.251170 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.251387 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.251487 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.251711 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.251795 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.252032 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.252117 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.252340 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.252560 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.252648 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.252916 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.253006 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.253235 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.253334 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.253566 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.253692 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.253879 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.253963 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.254187 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.254282 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.254494 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.254589 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.254797 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.254883 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.255113 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.255301 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.255582 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.255676 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.255957 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.256170 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.256276 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.256492 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.256580 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.256835 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.256933 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.257153 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.257252 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.257478 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.257564 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.257783 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.257876 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.258093 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.258188 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.258404 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.258496 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.258709 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.258794 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.259016 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.259112 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.259321 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.259405 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.259624 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.259709 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.259933 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.260018 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.260253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.260338 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.260565 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.260657 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.260902 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.260992 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.261217 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.261300 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.261529 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.261615 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.261837 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.261937 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.262145 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.262230 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.262451 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.262535 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.262757 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.262843 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.263069 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.263155 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.263394 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.263491 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.263706 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.263840 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.264011 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.264098 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.264359 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.264453 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.264722 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.264927 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.265062 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.265271 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.265381 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.265600 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.265687 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.265939 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.266032 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.266277 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.266371 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.266591 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.266683 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.266899 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.266984 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.267204 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.267299 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.267532 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.267616 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.267853 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.267938 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.268171 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.268264 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.268487 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.268573 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.268811 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.268903 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.269118 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.269221 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.269420 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.269507 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.269727 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.269812 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.270040 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.270126 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.270343 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.270426 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.270643 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.270728 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.271543 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.271684 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.271874 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.272121 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.272263 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.272453 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.272575 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.272793 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.272907 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.273122 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.273221 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.273472 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.273559 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.273793 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.273916 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.274097 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.274183 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.274397 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.274484 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.274699 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.274786 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.275000 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.275085 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.275308 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.275395 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.275615 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.275708 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.275917 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.276003 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.276222 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.276313 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.276523 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.276610 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.276856 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.276958 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.277159 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.277245 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.277487 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.277573 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.277817 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.277912 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.278130 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.278216 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.278450 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.278543 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.278758 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.278853 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.279078 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.279165 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.279433 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.279527 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.279705 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.279793 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.280023 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.280109 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.280334 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.280419 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.280641 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.280733 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.280995 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.281094 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.281305 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.281398 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.281613 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.281700 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.281925 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.282011 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.282234 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.282320 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.282540 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.282626 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.282847 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.282939 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.283165 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.283257 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.283481 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.283567 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.283782 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.283866 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.284084 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.284181 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.284400 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.284486 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.284712 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.284819 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.285047 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.285212 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.285357 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.285444 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.285667 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.285760 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.285979 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.286066 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.286280 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.286395 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.287327 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.287428 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.287657 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.287861 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.287975 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.288185 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.288297 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.288503 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.288597 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.288901 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.289003 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.289224 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.289310 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.289540 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.289627 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.289854 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.289947 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.290167 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.290252 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.290474 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.290560 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.290779 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.290863 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.291108 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.291193 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.291447 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.291533 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.291758 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.291849 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.292085 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.292169 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.292402 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.292489 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.292711 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.292811 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.293050 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.293149 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.293356 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.293441 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.293600 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 16:23:12.293686 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.293991 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.294309 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.294648 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.294967 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.295287 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.295609 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.295928 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.296249 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.296568 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.296936 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.297275 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.297591 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.297923 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.298246 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.298575 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.298901 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.299222 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.299558 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.299877 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.300196 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.300514 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.300858 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.301180 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.301513 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.301833 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.302289 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.302887 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.303227 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.303566 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.303903 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.304224 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.304558 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.304916 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.305275 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.305598 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.305952 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.306287 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.306611 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.306934 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.307248 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:23:12.307499 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 16:23:12.447096 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO dbcounter [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] Registered counter for database nova_api Aug 19 16:23:12.463633 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO dbcounter [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] Registered counter for database nova_api Aug 19 16:23:12.469596 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG oslo_db.sqlalchemy.engines [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 16:23:12.476019 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG dbcounter [-] [105532] Writer thread running {{(pid=105532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 16:23:12.483762 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_db.sqlalchemy.engines [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 16:23:12.490770 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writer thread running {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 16:23:12.531614 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.context [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30(cell1) {{(pid=105532) load_cells /opt/stack/nova/nova/context.py:464}} Aug 19 16:23:12.535400 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG oslo_concurrency.lockutils [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:23:12.535873 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG oslo_concurrency.lockutils [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:23:12.537648 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG oslo_concurrency.lockutils [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:23:12.538366 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG oslo_concurrency.lockutils [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:23:12.538811 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG oslo_concurrency.lockutils [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:23:12.540797 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG oslo_concurrency.lockutils [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:23:12.542759 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO dbcounter [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] Registered counter for database nova_cell0 Aug 19 16:23:12.547925 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.context [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30(cell1) {{(pid=105531) load_cells /opt/stack/nova/nova/context.py:464}} Aug 19 16:23:12.548081 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO dbcounter [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] Registered counter for database nova_cell1 Aug 19 16:23:12.551794 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:23:12.552418 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:23:12.554250 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:23:12.555019 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:23:12.555479 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:23:12.555965 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG oslo_db.sqlalchemy.engines [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 16:23:12.557562 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:23:12.557668 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG oslo_db.sqlalchemy.engines [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 16:23:12.559571 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO dbcounter [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] Registered counter for database nova_cell0 Aug 19 16:23:12.564524 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG dbcounter [-] [105532] Writer thread running {{(pid=105532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 16:23:12.564899 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG dbcounter [-] [105532] Writer thread running {{(pid=105532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 16:23:12.565064 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO dbcounter [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] Registered counter for database nova_cell1 Aug 19 16:23:12.573687 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_db.sqlalchemy.engines [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 16:23:12.576075 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_db.sqlalchemy.engines [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 16:23:12.581195 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writer thread running {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 16:23:12.584466 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writer thread running {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 16:23:12.709671 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO dbcounter [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] Registered counter for database nova_cell0 Aug 19 16:23:12.718723 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG oslo_db.sqlalchemy.engines [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 16:23:12.722984 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG dbcounter [-] [105532] Writer thread running {{(pid=105532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 16:23:12.727367 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO dbcounter [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] Registered counter for database nova_cell0 Aug 19 16:23:12.736258 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_db.sqlalchemy.engines [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 16:23:12.740601 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writer thread running {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 16:23:13.060760 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: WARNING keystonemiddleware.auth_token [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 16:23:13.061377 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: WARNING keystonemiddleware.auth_token [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 16:23:13.068502 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: WARNING keystonemiddleware.auth_token [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 16:23:13.069105 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: WARNING keystonemiddleware.auth_token [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 16:23:13.414973 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: WARNING keystonemiddleware.auth_token [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 16:23:13.416966 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: WARNING keystonemiddleware.auth_token [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 16:23:13.420914 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: WARNING keystonemiddleware.auth_token [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 16:23:13.422852 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: WARNING keystonemiddleware.auth_token [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 16:23:13.426160 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55db389939c0 pid: 105532 (default app) Aug 19 16:23:13.428604 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55db389939c0 pid: 105531 (default app) Aug 19 16:23:13.429033 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:23:13.430204 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-635c8cc1-ddc8-4d8d-96a5-4112186d0958 None None] 10.222.0.55 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001758 Aug 19 16:23:13.430621 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 788 bytes} [Fri Aug 19 16:23:13 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:24:31.127327 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:24:31.128458 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001948 Aug 19 16:24:31.129068 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 1/2] 10.222.0.55 () {54 vars in 931 bytes} [Fri Aug 19 16:24:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:24:31.140598 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG dbcounter [-] [105532] Writing DB stats nova_api:SELECT=3 {{(pid=105532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:24:31.142253 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG dbcounter [-] [105532] Writing DB stats nova_cell0:SELECT=3 {{(pid=105532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:24:31.143090 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG dbcounter [-] [105532] Writing DB stats nova_cell1:SELECT=3 {{(pid=105532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:24:31.143922 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG dbcounter [-] [105532] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:24:31.997387 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-600f48c1-98bb-43a3-a5c7-d348f2995ce6 admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:24:32.030253 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-600f48c1-98bb-43a3-a5c7-d348f2995ce6 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.894684 Aug 19 16:24:32.031361 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 2/3] 10.222.0.55 () {60 vars in 1292 bytes} [Fri Aug 19 16:24:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:24:34.369850 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:24:34.370640 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-79a34c7e-6864-4688-809c-fc19b661ab1b None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 19 16:24:34.376196 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 2/4] 10.222.0.55 () {54 vars in 931 bytes} [Fri Aug 19 16:24:34 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:24:34.828527 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-365fbe2d-c5e1-4e91-9c2f-0f922e2f06ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "c1", "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:24:34.849224 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:24:34.849224 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: warnings.warn(msg) Aug 19 16:24:34.879986 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-365fbe2d-c5e1-4e91-9c2f-0f922e2f06ca admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.502787 Aug 19 16:24:34.884807 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 3/5] 10.222.0.55 () {64 vars in 1283 bytes} [Fri Aug 19 16:24:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:24:34.895401 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writing DB stats nova_api:SELECT=3 {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:24:34.896324 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writing DB stats nova_cell0:SELECT=3 {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:24:34.897322 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writing DB stats nova_cell1:SELECT=3 {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:24:34.898421 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writing DB stats nova_cell0:SELECT=3 {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:24:35.106056 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-92606cc9-0b74-40fb-938b-e85d07aa7326 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:24:35.110473 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:24:35.110473 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: warnings.warn(msg) Aug 19 16:24:35.174222 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-92606cc9-0b74-40fb-938b-e85d07aa7326 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284322 Aug 19 16:24:35.174721 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 3/6] 10.222.0.55 () {64 vars in 1336 bytes} [Fri Aug 19 16:24:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:24:37.526709 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-365fbe2d-c5e1-4e91-9c2f-0f922e2f06ca admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:24:37.527713 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-365fbe2d-c5e1-4e91-9c2f-0f922e2f06ca admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 19 16:24:37.528122 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 4/7] 10.222.0.55 () {54 vars in 931 bytes} [Fri Aug 19 16:24:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:24:38.178915 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-f917ed8c-e2bd-4f8f-ab43-9685757b9b16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "ram": 512, "id": "d1", "rxtx_factor": 1.0, "disk": 5, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:24:38.199037 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:24:38.199037 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: warnings.warn(msg) Aug 19 16:24:38.221484 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-f917ed8c-e2bd-4f8f-ab43-9685757b9b16 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.686507 Aug 19 16:24:38.222280 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 4/8] 10.222.0.55 () {64 vars in 1283 bytes} [Fri Aug 19 16:24:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 16:24:38.234062 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-68af21bf-2973-424b-a73c-2252768b5ba3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:24:38.236862 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:24:38.236862 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: warnings.warn(msg) Aug 19 16:24:38.269864 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-68af21bf-2973-424b-a73c-2252768b5ba3 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039446 Aug 19 16:24:38.270689 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 5/9] 10.222.0.55 () {64 vars in 1336 bytes} [Fri Aug 19 16:24:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:24:40.623764 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-f917ed8c-e2bd-4f8f-ab43-9685757b9b16 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:24:40.624692 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-f917ed8c-e2bd-4f8f-ab43-9685757b9b16 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 19 16:24:40.625130 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 5/10] 10.222.0.55 () {54 vars in 931 bytes} [Fri Aug 19 16:24:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:24:41.031714 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-2b2752e7-9c22-439e-a710-2c3e52bf9020 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "ram": 1024, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:24:41.050630 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-2b2752e7-9c22-439e-a710-2c3e52bf9020 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.419625 Aug 19 16:24:41.051304 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 6/11] 10.222.0.55 () {64 vars in 1283 bytes} [Fri Aug 19 16:24:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:24:41.063966 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-4bea1aaa-04e4-4f6a-ad99-bb0f6cbd65de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:24:41.088316 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-4bea1aaa-04e4-4f6a-ad99-bb0f6cbd65de admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028622 Aug 19 16:24:41.088938 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 6/12] 10.222.0.55 () {64 vars in 1336 bytes} [Fri Aug 19 16:24:41 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:24:43.455659 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-2b2752e7-9c22-439e-a710-2c3e52bf9020 admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:24:43.456884 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-2b2752e7-9c22-439e-a710-2c3e52bf9020 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Aug 19 16:24:43.457398 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 7/13] 10.222.0.55 () {54 vars in 931 bytes} [Fri Aug 19 16:24:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:24:43.935698 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-2fcc2a74-9c7a-49ad-b7b6-37f3a98c28d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:24:43.955841 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-2fcc2a74-9c7a-49ad-b7b6-37f3a98c28d0 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.491344 Aug 19 16:24:43.956741 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 7/14] 10.222.0.55 () {64 vars in 1283 bytes} [Fri Aug 19 16:24:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:24:43.968994 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-6fcbde8d-640d-4839-a352-e64b0e402abf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:24:43.993007 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-6fcbde8d-640d-4839-a352-e64b0e402abf admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027781 Aug 19 16:24:43.993575 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 8/15] 10.222.0.55 () {64 vars in 1336 bytes} [Fri Aug 19 16:24:43 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:24:46.342821 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-2fcc2a74-9c7a-49ad-b7b6-37f3a98c28d0 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:24:46.343837 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-2fcc2a74-9c7a-49ad-b7b6-37f3a98c28d0 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 19 16:24:46.344253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 8/16] 10.222.0.55 () {54 vars in 931 bytes} [Fri Aug 19 16:24:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:24:46.807465 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-0b5fbb1b-b49e-4ef7-859a-c5fa6158f7ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "swap": 0, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 4}} {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:24:46.829842 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-0b5fbb1b-b49e-4ef7-859a-c5fa6158f7ed admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.478721 Aug 19 16:24:46.837983 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 9/17] 10.222.0.55 () {64 vars in 1283 bytes} [Fri Aug 19 16:24:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:24:46.843549 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-123e5375-f0a5-4039-9a8d-90ffab6b531c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:24:46.869411 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-123e5375-f0a5-4039-9a8d-90ffab6b531c admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030051 Aug 19 16:24:46.870107 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 9/18] 10.222.0.55 () {64 vars in 1336 bytes} [Fri Aug 19 16:24:46 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:24:49.281508 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-0b5fbb1b-b49e-4ef7-859a-c5fa6158f7ed admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:24:49.282505 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-0b5fbb1b-b49e-4ef7-859a-c5fa6158f7ed admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 19 16:24:49.282911 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 10/19] 10.222.0.55 () {54 vars in 931 bytes} [Fri Aug 19 16:24:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:24:49.712920 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-762875c5-f349-4200-8db0-a0934c1f1633 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:24:49.738834 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-762875c5-f349-4200-8db0-a0934c1f1633 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.449984 Aug 19 16:24:49.739399 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 10/20] 10.222.0.55 () {60 vars in 1292 bytes} [Fri Aug 19 16:24:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:24:52.154711 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-0b5fbb1b-b49e-4ef7-859a-c5fa6158f7ed admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:24:52.155688 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-0b5fbb1b-b49e-4ef7-859a-c5fa6158f7ed admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Aug 19 16:24:52.156101 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 11/21] 10.222.0.55 () {54 vars in 931 bytes} [Fri Aug 19 16:24:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:24:52.571109 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-45ad5e2c-1994-497e-9cc1-caa9ef42e7e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:24:52.592247 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-45ad5e2c-1994-497e-9cc1-caa9ef42e7e0 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.429847 Aug 19 16:24:52.592823 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 11/22] 10.222.0.55 () {64 vars in 1283 bytes} [Fri Aug 19 16:24:52 2022] POST /compute/v2.1/flavors => generated 402 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:24:52.605060 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-96309675-10eb-480f-b465-1357c8989b66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:24:52.629664 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-96309675-10eb-480f-b465-1357c8989b66 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028522 Aug 19 16:24:52.630247 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 12/23] 10.222.0.55 () {64 vars in 1333 bytes} [Fri Aug 19 16:24:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:24:54.993001 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-45ad5e2c-1994-497e-9cc1-caa9ef42e7e0 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:24:54.994011 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-45ad5e2c-1994-497e-9cc1-caa9ef42e7e0 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 19 16:24:54.994420 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 12/24] 10.222.0.55 () {54 vars in 931 bytes} [Fri Aug 19 16:24:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:24:55.444983 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-3dc3649b-9ee5-4c6b-9e91-88c61b1854ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "id": "2", "swap": 0, "name": "m1.small", "ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:24:55.466315 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-3dc3649b-9ee5-4c6b-9e91-88c61b1854ea admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.465429 Aug 19 16:24:55.466991 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 13/25] 10.222.0.55 () {64 vars in 1283 bytes} [Fri Aug 19 16:24:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:24:55.480701 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-a0f70ada-67d1-48b4-85e7-5359a121a8b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:24:55.512828 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-a0f70ada-67d1-48b4-85e7-5359a121a8b6 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034802 Aug 19 16:24:55.513452 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 13/26] 10.222.0.55 () {64 vars in 1333 bytes} [Fri Aug 19 16:24:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:24:57.882213 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-3dc3649b-9ee5-4c6b-9e91-88c61b1854ea admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:24:57.883237 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-3dc3649b-9ee5-4c6b-9e91-88c61b1854ea admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 19 16:24:57.883668 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 14/27] 10.222.0.55 () {54 vars in 931 bytes} [Fri Aug 19 16:24:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:24:58.285700 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-30e9b766-c62b-4a04-ac1d-b9a36a8b9c76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:24:58.305741 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-30e9b766-c62b-4a04-ac1d-b9a36a8b9c76 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.415157 Aug 19 16:24:58.306569 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 14/28] 10.222.0.55 () {64 vars in 1283 bytes} [Fri Aug 19 16:24:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:24:58.319382 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-8aa05cfd-1244-420c-89d8-fc4e17422ade admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:24:58.348940 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-8aa05cfd-1244-420c-89d8-fc4e17422ade admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033446 Aug 19 16:24:58.349540 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 15/29] 10.222.0.55 () {64 vars in 1333 bytes} [Fri Aug 19 16:24:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:25:00.702330 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-30e9b766-c62b-4a04-ac1d-b9a36a8b9c76 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:00.703337 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-30e9b766-c62b-4a04-ac1d-b9a36a8b9c76 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 19 16:25:00.703747 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 15/30] 10.222.0.55 () {54 vars in 931 bytes} [Fri Aug 19 16:25:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:25:01.182615 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-da402dc1-19cd-49fd-874b-717bb6185964 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "swap": 0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "rxtx_factor": 1.0, "disk": 80, "os-flavor-access:is_public": true}} {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:25:01.193252 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG dbcounter [-] [105532] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:25:01.205835 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-da402dc1-19cd-49fd-874b-717bb6185964 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.495628 Aug 19 16:25:01.208894 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 16/31] 10.222.0.55 () {64 vars in 1283 bytes} [Fri Aug 19 16:25:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:25:01.219106 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-593d7939-c10e-4770-8fd7-1a5854a7a777 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:25:01.245923 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-593d7939-c10e-4770-8fd7-1a5854a7a777 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030317 Aug 19 16:25:01.246491 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 16/32] 10.222.0.55 () {64 vars in 1333 bytes} [Fri Aug 19 16:25:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:25:03.615691 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-da402dc1-19cd-49fd-874b-717bb6185964 admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:03.616694 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-da402dc1-19cd-49fd-874b-717bb6185964 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 19 16:25:03.617144 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 17/33] 10.222.0.55 () {54 vars in 931 bytes} [Fri Aug 19 16:25:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:25:04.084434 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-53e196cc-2cba-4258-a9f5-583656dfbd79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "vcpus": 8}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:25:04.106920 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-53e196cc-2cba-4258-a9f5-583656dfbd79 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.483165 Aug 19 16:25:04.108224 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 17/34] 10.222.0.55 () {64 vars in 1283 bytes} [Fri Aug 19 16:25:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:25:04.119646 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-c4175e13-d895-4981-85cf-4d4cfbfa8130 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:25:04.147467 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-c4175e13-d895-4981-85cf-4d4cfbfa8130 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031447 Aug 19 16:25:04.157378 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 18/35] 10.222.0.55 () {64 vars in 1333 bytes} [Fri Aug 19 16:25:04 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:25:22.931474 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-53e196cc-2cba-4258-a9f5-583656dfbd79 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:22.932397 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-53e196cc-2cba-4258-a9f5-583656dfbd79 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 19 16:25:22.933316 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 18/36] 10.222.0.55 () {54 vars in 931 bytes} [Fri Aug 19 16:25:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:25:22.943895 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG dbcounter [-] [105532] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:25:23.323314 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-c6802b95-2dfa-48e7-8d89-606f9c73817d admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:23.341435 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-c6802b95-2dfa-48e7-8d89-606f9c73817d admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401907 Aug 19 16:25:23.341965 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 19/37] 10.222.0.55 () {60 vars in 1292 bytes} [Fri Aug 19 16:25:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:25:24.387526 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-53e196cc-2cba-4258-a9f5-583656dfbd79 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:24.388542 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-53e196cc-2cba-4258-a9f5-583656dfbd79 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001949 Aug 19 16:25:24.388961 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 19/38] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Aug 19 16:25:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:25:24.906446 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-fc00f4dd-e7b5-4f1d-af46-7bf552c35866 admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:24.912044 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.wsgi [None req-fc00f4dd-e7b5-4f1d-af46-7bf552c35866 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-fc00f4dd-e7b5-4f1d-af46-7bf552c35866 admin admin] Request method failure captured: Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Accept: application/json Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Accept-Encoding: gzip, deflate Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Connection: keep-alive Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Content-Length: 0 Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Host: 10.222.0.55 Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Openstack-Api-Version: compute 2.90 Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Openstack-System-Scope: None Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: User-Agent: python-novaclient Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Auth-Token: gAAAAABi_7l0B3Swcg7tvnRUcIh_nn1L97NYL-IXJLDUYT7psnXnhQHK1C1o00CGlTZvOioDNclwIIKvGYpoH8eM46dBaOwbmvuPGxpBuxSwZYj4WP7_8j76vQIh3P0fcIORBYCIkukdPYir86VQgvnQu94bgz5OCgALDu9wr7x-uc6fRE20knw Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Domain-Id: None Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Domain-Name: None Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Identity-Status: Confirmed Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Is-Admin-Project: True Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Openstack-Nova-Api-Version: 2.90 Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Project-Domain-Id: default Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Project-Domain-Name: Default Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Project-Id: 61d450c451d94f27b564ec08cc487161 Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Project-Name: admin Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Role: member,admin,reader Aug 19 16:25:24.915329 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Roles: member,admin,reader Aug 19 16:25:24.916986 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_61d450c451d94f27b564ec08cc487161"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/61d450c451d94f27b564ec08cc487161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/61d450c451d94f27b564ec08cc487161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/61d450c451d94f27b564ec08cc487161"}]}] Aug 19 16:25:24.916986 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Tenant: admin Aug 19 16:25:24.916986 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Tenant-Id: 61d450c451d94f27b564ec08cc487161 Aug 19 16:25:24.916986 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Tenant-Name: admin Aug 19 16:25:24.916986 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-User: admin Aug 19 16:25:24.916986 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-User-Domain-Id: default Aug 19 16:25:24.916986 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-User-Domain-Name: Default Aug 19 16:25:24.916986 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-User-Id: 1decd3055af14f42987a890baebb81a7 Aug 19 16:25:24.916986 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-User-Name: admin Aug 19 16:25:24.916986 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: method: > Aug 19 16:25:24.916986 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: exception: Flavor 42 could not be found. Aug 19 16:25:24.916986 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: action_args: {'id': '42'} Aug 19 16:25:24.916986 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:25:24.916986 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:25:24.918556 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 19 16:25:24.918556 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 19 16:25:24.918556 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 19 16:25:24.918556 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 19 16:25:24.918556 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 16:25:24.918556 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 16:25:24.918556 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 19 16:25:24.918556 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 19 16:25:24.918556 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 19 16:25:24.918556 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:25:24.918556 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 19 16:25:24.918556 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 19 16:25:24.918556 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 19 16:25:24.918556 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Aug 19 16:25:24.918556 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:25:24.918556 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Aug 19 16:25:24.918556 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:25:24.918556 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:25:24.918556 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:25:24.920036 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:25:24.920036 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:25:24.920036 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:25:24.920036 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:25:24.920036 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 19 16:25:24.920036 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:25:24.920036 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 19 16:25:24.920036 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Aug 19 16:25:24.920036 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:25:24.920036 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Aug 19 16:25:24.920036 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:25:24.920036 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:25:24.920036 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:25:24.920036 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:25:24.920036 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:25:24.920036 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 19 16:25:24.920036 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Aug 19 16:25:24.920036 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-fc00f4dd-e7b5-4f1d-af46-7bf552c35866 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:25:24.921360 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-fc00f4dd-e7b5-4f1d-af46-7bf552c35866 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.392677 Aug 19 16:25:24.921360 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 20/39] 10.222.0.55 () {60 vars in 1190 bytes} [Fri Aug 19 16:25:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 19 16:25:24.926827 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-72d7bbae-5c87-409e-9a6c-13dd3886f1a9 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:24.931012 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:25:24.950905 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-72d7bbae-5c87-409e-9a6c-13dd3886f1a9 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027555 Aug 19 16:25:24.951430 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 20/40] 10.222.0.55 () {60 vars in 1210 bytes} [Fri Aug 19 16:25:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:25:24.961371 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-9485b328-8e79-4d58-a6f9-7d0b43b1aa07 admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:24.985351 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-9485b328-8e79-4d58-a6f9-7d0b43b1aa07 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027809 Aug 19 16:25:24.985891 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 21/41] 10.222.0.55 () {60 vars in 1210 bytes} [Fri Aug 19 16:25:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:25:24.995126 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-76e91d22-2461-4f30-a442-7ff4790c1550 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:25.002209 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.wsgi [None req-76e91d22-2461-4f30-a442-7ff4790c1550 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-76e91d22-2461-4f30-a442-7ff4790c1550 admin admin] Request method failure captured: Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Accept: application/json Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Accept-Encoding: gzip, deflate Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Connection: keep-alive Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Content-Length: 0 Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Host: 10.222.0.55 Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Openstack-Api-Version: compute 2.90 Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Openstack-System-Scope: None Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: User-Agent: python-novaclient Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Auth-Token: gAAAAABi_7l0B3Swcg7tvnRUcIh_nn1L97NYL-IXJLDUYT7psnXnhQHK1C1o00CGlTZvOioDNclwIIKvGYpoH8eM46dBaOwbmvuPGxpBuxSwZYj4WP7_8j76vQIh3P0fcIORBYCIkukdPYir86VQgvnQu94bgz5OCgALDu9wr7x-uc6fRE20knw Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Domain-Id: None Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Domain-Name: None Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Identity-Status: Confirmed Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Is-Admin-Project: True Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Openstack-Nova-Api-Version: 2.90 Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Project-Domain-Id: default Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Project-Domain-Name: Default Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Project-Id: 61d450c451d94f27b564ec08cc487161 Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Project-Name: admin Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Role: member,admin,reader Aug 19 16:25:25.005436 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Roles: member,admin,reader Aug 19 16:25:25.006943 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_61d450c451d94f27b564ec08cc487161"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/61d450c451d94f27b564ec08cc487161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/61d450c451d94f27b564ec08cc487161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/61d450c451d94f27b564ec08cc487161"}]}] Aug 19 16:25:25.006943 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Tenant: admin Aug 19 16:25:25.006943 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Tenant-Id: 61d450c451d94f27b564ec08cc487161 Aug 19 16:25:25.006943 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Tenant-Name: admin Aug 19 16:25:25.006943 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-User: admin Aug 19 16:25:25.006943 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-User-Domain-Id: default Aug 19 16:25:25.006943 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-User-Domain-Name: Default Aug 19 16:25:25.006943 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-User-Id: 1decd3055af14f42987a890baebb81a7 Aug 19 16:25:25.006943 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-User-Name: admin Aug 19 16:25:25.006943 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: method: > Aug 19 16:25:25.006943 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: exception: Flavor 42 could not be found. Aug 19 16:25:25.006943 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: action_args: {'id': '42'} Aug 19 16:25:25.006943 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:25:25.006943 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:25:25.007854 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 19 16:25:25.007854 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 19 16:25:25.007854 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 19 16:25:25.007854 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 19 16:25:25.007854 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 16:25:25.007854 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 16:25:25.007854 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 19 16:25:25.007854 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 19 16:25:25.007854 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 19 16:25:25.007854 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:25:25.007854 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 19 16:25:25.007854 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 19 16:25:25.007854 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 19 16:25:25.007854 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 19 16:25:25.007854 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:25:25.007854 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 19 16:25:25.007854 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:25:25.007854 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:25:25.007854 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:25:25.008960 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:25:25.008960 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:25:25.008960 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:25:25.008960 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:25:25.008960 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 19 16:25:25.008960 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:25:25.008960 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 19 16:25:25.008960 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 19 16:25:25.008960 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:25:25.008960 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 19 16:25:25.008960 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:25:25.008960 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:25:25.008960 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:25:25.008960 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:25:25.008960 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:25:25.008960 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 19 16:25:25.008960 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 19 16:25:25.008960 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-76e91d22-2461-4f30-a442-7ff4790c1550 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:25:25.009939 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-76e91d22-2461-4f30-a442-7ff4790c1550 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015228 Aug 19 16:25:25.009939 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 21/42] 10.222.0.55 () {60 vars in 1190 bytes} [Fri Aug 19 16:25:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 19 16:25:25.975729 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-9485b328-8e79-4d58-a6f9-7d0b43b1aa07 admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:25.976735 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-9485b328-8e79-4d58-a6f9-7d0b43b1aa07 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 19 16:25:25.977193 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 22/43] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Aug 19 16:25:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:25:26.503371 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-0b7f171c-ae03-4a10-b2dc-1a12f820ce66 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:26.508741 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.wsgi [None req-0b7f171c-ae03-4a10-b2dc-1a12f820ce66 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-0b7f171c-ae03-4a10-b2dc-1a12f820ce66 admin admin] Request method failure captured: Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Accept: application/json Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Accept-Encoding: gzip, deflate Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Connection: keep-alive Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Content-Length: 0 Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Host: 10.222.0.55 Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Openstack-Api-Version: compute 2.90 Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Openstack-System-Scope: None Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: User-Agent: python-novaclient Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Auth-Token: gAAAAABi_7l1uMpgf84NCA43SAiULIuiSIdPngJk4plSV-I1NTN7yDX1P9EpwmGRzxJCWmP-LgBfPGMZtagdilYxZOFVXv4CqMpucifzaolOn6ebgcEdmocx-rgHtUZYh5u_lGbsYZ4MhPvSgXnQBTjpmL8c4ZGS7-jqed4yHmVdWL4OS5YzqW8 Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Domain-Id: None Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Domain-Name: None Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Identity-Status: Confirmed Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Is-Admin-Project: True Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Openstack-Nova-Api-Version: 2.90 Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Project-Domain-Id: default Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Project-Domain-Name: Default Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Project-Id: 61d450c451d94f27b564ec08cc487161 Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Project-Name: admin Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Role: member,admin,reader Aug 19 16:25:26.510253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Roles: member,admin,reader Aug 19 16:25:26.512209 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_61d450c451d94f27b564ec08cc487161"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/61d450c451d94f27b564ec08cc487161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/61d450c451d94f27b564ec08cc487161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/61d450c451d94f27b564ec08cc487161"}]}] Aug 19 16:25:26.512209 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Tenant: admin Aug 19 16:25:26.512209 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Tenant-Id: 61d450c451d94f27b564ec08cc487161 Aug 19 16:25:26.512209 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Tenant-Name: admin Aug 19 16:25:26.512209 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-User: admin Aug 19 16:25:26.512209 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-User-Domain-Id: default Aug 19 16:25:26.512209 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-User-Domain-Name: Default Aug 19 16:25:26.512209 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-User-Id: 1decd3055af14f42987a890baebb81a7 Aug 19 16:25:26.512209 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-User-Name: admin Aug 19 16:25:26.512209 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: method: > Aug 19 16:25:26.512209 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: exception: Flavor 84 could not be found. Aug 19 16:25:26.512209 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: action_args: {'id': '84'} Aug 19 16:25:26.512209 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:25:26.512209 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:25:26.513004 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 19 16:25:26.513004 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 19 16:25:26.513004 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 19 16:25:26.513004 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 19 16:25:26.513004 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 16:25:26.513004 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 16:25:26.513004 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 19 16:25:26.513004 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 19 16:25:26.513004 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 19 16:25:26.513004 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:25:26.513004 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 19 16:25:26.513004 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 19 16:25:26.513004 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 19 16:25:26.513004 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 19 16:25:26.513004 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:25:26.513004 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 19 16:25:26.513004 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:25:26.513004 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:25:26.513004 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:25:26.514030 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:25:26.514030 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:25:26.514030 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:25:26.514030 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:25:26.514030 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 19 16:25:26.514030 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:25:26.514030 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 19 16:25:26.514030 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 19 16:25:26.514030 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:25:26.514030 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 19 16:25:26.514030 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:25:26.514030 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:25:26.514030 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:25:26.514030 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:25:26.514030 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:25:26.514030 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 19 16:25:26.514030 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 19 16:25:26.514030 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-0b7f171c-ae03-4a10-b2dc-1a12f820ce66 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:25:26.515236 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-0b7f171c-ae03-4a10-b2dc-1a12f820ce66 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.392746 Aug 19 16:25:26.515236 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 22/44] 10.222.0.55 () {60 vars in 1190 bytes} [Fri Aug 19 16:25:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 19 16:25:26.521925 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-6f6e0de8-ebac-4400-9320-000ac931f92f admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:26.537687 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-6f6e0de8-ebac-4400-9320-000ac931f92f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019167 Aug 19 16:25:26.538159 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 23/45] 10.222.0.55 () {60 vars in 1210 bytes} [Fri Aug 19 16:25:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:25:26.547639 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-988a5762-d610-4f59-a6fc-ace7ee799f01 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:26.564200 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-988a5762-d610-4f59-a6fc-ace7ee799f01 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020051 Aug 19 16:25:26.564728 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 23/46] 10.222.0.55 () {60 vars in 1210 bytes} [Fri Aug 19 16:25:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:25:26.574691 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-e508ecce-9ce7-4515-8f96-cf5f01d462b5 admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:26.579977 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.wsgi [None req-e508ecce-9ce7-4515-8f96-cf5f01d462b5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-e508ecce-9ce7-4515-8f96-cf5f01d462b5 admin admin] Request method failure captured: Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Accept: application/json Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Accept-Encoding: gzip, deflate Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Connection: keep-alive Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Content-Length: 0 Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Host: 10.222.0.55 Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Openstack-Api-Version: compute 2.90 Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Openstack-System-Scope: None Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: User-Agent: python-novaclient Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Auth-Token: gAAAAABi_7l1uMpgf84NCA43SAiULIuiSIdPngJk4plSV-I1NTN7yDX1P9EpwmGRzxJCWmP-LgBfPGMZtagdilYxZOFVXv4CqMpucifzaolOn6ebgcEdmocx-rgHtUZYh5u_lGbsYZ4MhPvSgXnQBTjpmL8c4ZGS7-jqed4yHmVdWL4OS5YzqW8 Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Domain-Id: None Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Domain-Name: None Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Identity-Status: Confirmed Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Is-Admin-Project: True Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Openstack-Nova-Api-Version: 2.90 Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Project-Domain-Id: default Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Project-Domain-Name: Default Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Project-Id: 61d450c451d94f27b564ec08cc487161 Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Project-Name: admin Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Role: member,admin,reader Aug 19 16:25:26.581497 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Roles: member,admin,reader Aug 19 16:25:26.583240 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_61d450c451d94f27b564ec08cc487161"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/61d450c451d94f27b564ec08cc487161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/61d450c451d94f27b564ec08cc487161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/61d450c451d94f27b564ec08cc487161"}]}] Aug 19 16:25:26.583240 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Tenant: admin Aug 19 16:25:26.583240 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Tenant-Id: 61d450c451d94f27b564ec08cc487161 Aug 19 16:25:26.583240 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Tenant-Name: admin Aug 19 16:25:26.583240 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-User: admin Aug 19 16:25:26.583240 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-User-Domain-Id: default Aug 19 16:25:26.583240 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-User-Domain-Name: Default Aug 19 16:25:26.583240 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-User-Id: 1decd3055af14f42987a890baebb81a7 Aug 19 16:25:26.583240 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-User-Name: admin Aug 19 16:25:26.583240 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: method: > Aug 19 16:25:26.583240 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: exception: Flavor 84 could not be found. Aug 19 16:25:26.583240 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: action_args: {'id': '84'} Aug 19 16:25:26.583240 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:25:26.583240 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:25:26.584172 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 19 16:25:26.584172 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 19 16:25:26.584172 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 19 16:25:26.584172 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 19 16:25:26.584172 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 16:25:26.584172 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 16:25:26.584172 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 19 16:25:26.584172 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 19 16:25:26.584172 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 19 16:25:26.584172 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:25:26.584172 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 19 16:25:26.584172 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 19 16:25:26.584172 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 19 16:25:26.584172 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Aug 19 16:25:26.584172 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:25:26.584172 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Aug 19 16:25:26.584172 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:25:26.584172 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:25:26.584172 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:25:26.585502 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:25:26.585502 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:25:26.585502 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:25:26.585502 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:25:26.585502 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 19 16:25:26.585502 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:25:26.585502 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 19 16:25:26.585502 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Aug 19 16:25:26.585502 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:25:26.585502 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Aug 19 16:25:26.585502 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:25:26.585502 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:25:26.585502 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:25:26.585502 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:25:26.585502 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:25:26.585502 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 19 16:25:26.585502 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Aug 19 16:25:26.585502 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-e508ecce-9ce7-4515-8f96-cf5f01d462b5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:25:26.586677 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-e508ecce-9ce7-4515-8f96-cf5f01d462b5 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012271 Aug 19 16:25:26.586677 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 24/47] 10.222.0.55 () {60 vars in 1190 bytes} [Fri Aug 19 16:25:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 19 16:25:27.557768 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-988a5762-d610-4f59-a6fc-ace7ee799f01 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:27.558892 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-988a5762-d610-4f59-a6fc-ace7ee799f01 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Aug 19 16:25:27.559357 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 24/48] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Aug 19 16:25:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:25:28.079370 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-6436d2fa-dda1-4500-9126-b51b4bb66312 admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:28.085330 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.wsgi [None req-6436d2fa-dda1-4500-9126-b51b4bb66312 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-6436d2fa-dda1-4500-9126-b51b4bb66312 admin admin] Request method failure captured: Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Accept: application/json Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Accept-Encoding: gzip, deflate Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Connection: keep-alive Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Content-Length: 0 Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Host: 10.222.0.55 Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Openstack-Api-Version: compute 2.90 Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Openstack-System-Scope: None Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: User-Agent: python-novaclient Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Auth-Token: gAAAAABi_7l391sUwgELiG3G2SK-QdJubd0V3owCVr9j3SQygQepVdQerp27xa2UX74g_tG5BEFqy3T8Wi57K5D4RWJHU3xWnxBxnz3RQJnON_9cIDvKuffdfOFgx3nqjXA8iQ2cCmus-fRfdg-XRlv-v9r_tW4pcz2dD2a3ZX8zk5QJX3hDhlQ Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Domain-Id: None Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Domain-Name: None Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Identity-Status: Confirmed Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Is-Admin-Project: True Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Openstack-Nova-Api-Version: 2.90 Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Project-Domain-Id: default Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Project-Domain-Name: Default Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Project-Id: 61d450c451d94f27b564ec08cc487161 Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Project-Name: admin Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Role: member,admin,reader Aug 19 16:25:28.086834 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Roles: member,admin,reader Aug 19 16:25:28.088303 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_61d450c451d94f27b564ec08cc487161"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/61d450c451d94f27b564ec08cc487161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/61d450c451d94f27b564ec08cc487161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/61d450c451d94f27b564ec08cc487161"}]}] Aug 19 16:25:28.088303 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Tenant: admin Aug 19 16:25:28.088303 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Tenant-Id: 61d450c451d94f27b564ec08cc487161 Aug 19 16:25:28.088303 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-Tenant-Name: admin Aug 19 16:25:28.088303 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-User: admin Aug 19 16:25:28.088303 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-User-Domain-Id: default Aug 19 16:25:28.088303 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-User-Domain-Name: Default Aug 19 16:25:28.088303 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-User-Id: 1decd3055af14f42987a890baebb81a7 Aug 19 16:25:28.088303 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: X-User-Name: admin Aug 19 16:25:28.088303 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: method: > Aug 19 16:25:28.088303 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: exception: Flavor 451 could not be found. Aug 19 16:25:28.088303 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: action_args: {'id': '451'} Aug 19 16:25:28.088303 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:25:28.088303 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:25:28.089162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 19 16:25:28.089162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 19 16:25:28.089162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 19 16:25:28.089162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 19 16:25:28.089162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 16:25:28.089162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 16:25:28.089162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 19 16:25:28.089162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 19 16:25:28.089162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 19 16:25:28.089162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:25:28.089162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 19 16:25:28.089162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 19 16:25:28.089162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 19 16:25:28.089162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Aug 19 16:25:28.089162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:25:28.089162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Aug 19 16:25:28.089162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:25:28.089162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:25:28.089162 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:25:28.091064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:25:28.091064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:25:28.091064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:25:28.091064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:25:28.091064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 19 16:25:28.091064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:25:28.091064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 19 16:25:28.091064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Aug 19 16:25:28.091064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:25:28.091064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Aug 19 16:25:28.091064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:25:28.091064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:25:28.091064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:25:28.091064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:25:28.091064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:25:28.091064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 19 16:25:28.091064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: ERROR nova.api.openstack.wsgi Aug 19 16:25:28.091064 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-6436d2fa-dda1-4500-9126-b51b4bb66312 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:25:28.092136 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-6436d2fa-dda1-4500-9126-b51b4bb66312 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.391542 Aug 19 16:25:28.092136 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 25/49] 10.222.0.55 () {60 vars in 1193 bytes} [Fri Aug 19 16:25:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 19 16:25:28.099159 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-ced528fd-5b24-40fc-9248-83198904d0db admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:28.113887 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-ced528fd-5b24-40fc-9248-83198904d0db admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018259 Aug 19 16:25:28.114415 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 25/50] 10.222.0.55 () {60 vars in 1210 bytes} [Fri Aug 19 16:25:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:25:28.124237 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-1b04b95c-e4a6-4c91-b913-ffb8f0ed5cb5 admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:28.139802 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-1b04b95c-e4a6-4c91-b913-ffb8f0ed5cb5 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019598 Aug 19 16:25:28.140327 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 26/51] 10.222.0.55 () {60 vars in 1210 bytes} [Fri Aug 19 16:25:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:25:28.149303 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-6704fb65-0b2e-4c7e-9f0e-f5bb5f6cea4b admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:28.154581 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.wsgi [None req-6704fb65-0b2e-4c7e-9f0e-f5bb5f6cea4b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-6704fb65-0b2e-4c7e-9f0e-f5bb5f6cea4b admin admin] Request method failure captured: Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Accept: application/json Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Accept-Encoding: gzip, deflate Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Connection: keep-alive Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Content-Length: 0 Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Host: 10.222.0.55 Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Openstack-Api-Version: compute 2.90 Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Openstack-System-Scope: None Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: User-Agent: python-novaclient Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Auth-Token: gAAAAABi_7l391sUwgELiG3G2SK-QdJubd0V3owCVr9j3SQygQepVdQerp27xa2UX74g_tG5BEFqy3T8Wi57K5D4RWJHU3xWnxBxnz3RQJnON_9cIDvKuffdfOFgx3nqjXA8iQ2cCmus-fRfdg-XRlv-v9r_tW4pcz2dD2a3ZX8zk5QJX3hDhlQ Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Domain-Id: None Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Domain-Name: None Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Identity-Status: Confirmed Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Is-Admin-Project: True Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Openstack-Nova-Api-Version: 2.90 Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Project-Domain-Id: default Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Project-Domain-Name: Default Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Project-Id: 61d450c451d94f27b564ec08cc487161 Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Project-Name: admin Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Role: member,admin,reader Aug 19 16:25:28.156118 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Roles: member,admin,reader Aug 19 16:25:28.157674 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_61d450c451d94f27b564ec08cc487161"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/61d450c451d94f27b564ec08cc487161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/61d450c451d94f27b564ec08cc487161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/61d450c451d94f27b564ec08cc487161"}]}] Aug 19 16:25:28.157674 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Tenant: admin Aug 19 16:25:28.157674 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Tenant-Id: 61d450c451d94f27b564ec08cc487161 Aug 19 16:25:28.157674 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-Tenant-Name: admin Aug 19 16:25:28.157674 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-User: admin Aug 19 16:25:28.157674 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-User-Domain-Id: default Aug 19 16:25:28.157674 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-User-Domain-Name: Default Aug 19 16:25:28.157674 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-User-Id: 1decd3055af14f42987a890baebb81a7 Aug 19 16:25:28.157674 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: X-User-Name: admin Aug 19 16:25:28.157674 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: method: > Aug 19 16:25:28.157674 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: exception: Flavor 451 could not be found. Aug 19 16:25:28.157674 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: action_args: {'id': '451'} Aug 19 16:25:28.157674 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:25:28.157674 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:25:28.158751 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 19 16:25:28.158751 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 19 16:25:28.158751 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 19 16:25:28.158751 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 19 16:25:28.158751 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 16:25:28.158751 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 16:25:28.158751 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 19 16:25:28.158751 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 19 16:25:28.158751 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 19 16:25:28.158751 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:25:28.158751 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 19 16:25:28.158751 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 19 16:25:28.158751 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 19 16:25:28.158751 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 19 16:25:28.158751 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:25:28.158751 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 19 16:25:28.158751 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:25:28.158751 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:25:28.158751 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:25:28.160140 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:25:28.160140 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:25:28.160140 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:25:28.160140 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:25:28.160140 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 19 16:25:28.160140 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:25:28.160140 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 19 16:25:28.160140 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 19 16:25:28.160140 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:25:28.160140 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 19 16:25:28.160140 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:25:28.160140 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:25:28.160140 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:25:28.160140 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:25:28.160140 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:25:28.160140 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 19 16:25:28.160140 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 19 16:25:28.160140 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-6704fb65-0b2e-4c7e-9f0e-f5bb5f6cea4b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:25:28.161376 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-6704fb65-0b2e-4c7e-9f0e-f5bb5f6cea4b admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011634 Aug 19 16:25:28.161376 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 26/52] 10.222.0.55 () {60 vars in 1193 bytes} [Fri Aug 19 16:25:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 19 16:25:29.130000 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-1b04b95c-e4a6-4c91-b913-ffb8f0ed5cb5 admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:29.130997 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-1b04b95c-e4a6-4c91-b913-ffb8f0ed5cb5 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 19 16:25:29.131394 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 27/53] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Aug 19 16:25:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:25:29.653700 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-71c97be7-7965-441b-9f65-bd0826d62ca3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:25:29.672865 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-71c97be7-7965-441b-9f65-bd0826d62ca3 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.400319 Aug 19 16:25:29.673406 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 27/54] 10.222.0.55 () {64 vars in 1235 bytes} [Fri Aug 19 16:25:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:25:30.637334 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-1b04b95c-e4a6-4c91-b913-ffb8f0ed5cb5 admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:30.638330 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-1b04b95c-e4a6-4c91-b913-ffb8f0ed5cb5 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Aug 19 16:25:30.638737 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 28/55] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Aug 19 16:25:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:25:31.169399 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-c5dfe0ed-e401-46bc-9502-6447c9256559 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:25:31.188150 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-c5dfe0ed-e401-46bc-9502-6447c9256559 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.413545 Aug 19 16:25:31.188698 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 28/56] 10.222.0.55 () {64 vars in 1235 bytes} [Fri Aug 19 16:25:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:25:32.158371 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-1b04b95c-e4a6-4c91-b913-ffb8f0ed5cb5 admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:32.159386 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-1b04b95c-e4a6-4c91-b913-ffb8f0ed5cb5 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 19 16:25:32.159780 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 29/57] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Aug 19 16:25:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:25:32.679640 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-0aa460d5-e062-4c0b-8c60-81ec40d521d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:25:32.699898 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-0aa460d5-e062-4c0b-8c60-81ec40d521d7 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.402209 Aug 19 16:25:32.700431 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 29/58] 10.222.0.55 () {64 vars in 1235 bytes} [Fri Aug 19 16:25:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:25:33.669157 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-1b04b95c-e4a6-4c91-b913-ffb8f0ed5cb5 admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:33.670151 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-1b04b95c-e4a6-4c91-b913-ffb8f0ed5cb5 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002212 Aug 19 16:25:33.670550 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 30/59] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Aug 19 16:25:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:25:34.307247 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-dd31fd36-6f5f-4daa-abba-ce8322c88a41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:25:34.325554 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-dd31fd36-6f5f-4daa-abba-ce8322c88a41 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.519153 Aug 19 16:25:34.326028 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 30/60] 10.222.0.55 () {64 vars in 1235 bytes} [Fri Aug 19 16:25:33 2022] POST /compute/v2.1/flavors => generated 409 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:25:35.298238 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-1b04b95c-e4a6-4c91-b913-ffb8f0ed5cb5 admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:35.299259 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-1b04b95c-e4a6-4c91-b913-ffb8f0ed5cb5 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 19 16:25:35.299659 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 31/61] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Aug 19 16:25:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:25:35.825874 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-0afcb764-8624-4147-a33d-a6651481c37e admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:25:35.846155 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-0afcb764-8624-4147-a33d-a6651481c37e admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402529 Aug 19 16:25:35.846685 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 31/62] 10.222.0.55 () {60 vars in 1202 bytes} [Fri Aug 19 16:25:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:26:28.800281 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-1b04b95c-e4a6-4c91-b913-ffb8f0ed5cb5 admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:26:28.801322 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-1b04b95c-e4a6-4c91-b913-ffb8f0ed5cb5 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 19 16:26:28.801731 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 32/63] 10.222.0.55 () {54 vars in 931 bytes} [Fri Aug 19 16:26:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:26:28.812774 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:26:29.193133 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-d3f32b35-dd36-40b2-9519-0e6a47f060a0 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:26:29.213253 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-d3f32b35-dd36-40b2-9519-0e6a47f060a0 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405583 Aug 19 16:26:29.213721 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 32/64] 10.222.0.55 () {60 vars in 1292 bytes} [Fri Aug 19 16:26:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:26:29.236953 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG dbcounter [-] [105532] Writing DB stats nova_api:SELECT=14 {{(pid=105532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:26:29.240680 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-d27048ee-97f3-4d9e-b503-9cafca12019f admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:26:29.248390 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-d27048ee-97f3-4d9e-b503-9cafca12019f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012897 Aug 19 16:26:29.248935 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 33/65] 10.222.0.55 () {60 vars in 1283 bytes} [Fri Aug 19 16:26:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:26:29.260570 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-cbc05e73-b1ac-4c29-abaf-24f613031829 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:26:29.268776 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-cbc05e73-b1ac-4c29-abaf-24f613031829 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011776 Aug 19 16:26:29.269296 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 33/66] 10.222.0.55 () {60 vars in 1286 bytes} [Fri Aug 19 16:26:29 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:26:29.281226 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-69438d21-7f34-4964-b07d-25914845e414 admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:26:29.288683 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-69438d21-7f34-4964-b07d-25914845e414 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011789 Aug 19 16:26:29.289241 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 34/67] 10.222.0.55 () {60 vars in 1286 bytes} [Fri Aug 19 16:26:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:26:29.300406 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-6535d61f-482b-46a0-b01c-5b09731b3941 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:26:29.307846 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-6535d61f-482b-46a0-b01c-5b09731b3941 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010978 Aug 19 16:26:29.308358 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 34/68] 10.222.0.55 () {60 vars in 1283 bytes} [Fri Aug 19 16:26:29 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:29:46.874138 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-69438d21-7f34-4964-b07d-25914845e414 admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:29:46.875262 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-69438d21-7f34-4964-b07d-25914845e414 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Aug 19 16:29:46.875657 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 35/69] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Aug 19 16:29:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:29:47.026378 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writing DB stats nova_api:SELECT=6 {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:47.193042 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-d4a94909-0da5-4317-84eb-53b94b1e2d48 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:29:47.195380 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:29:47.195380 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: warnings.warn(msg) Aug 19 16:29:47.196487 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-d4a94909-0da5-4317-84eb-53b94b1e2d48 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:29:47.196987 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-d4a94909-0da5-4317-84eb-53b94b1e2d48 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:29:47.197411 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-d4a94909-0da5-4317-84eb-53b94b1e2d48 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:29:47.198110 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-d4a94909-0da5-4317-84eb-53b94b1e2d48 admin admin] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:29:47.198555 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-d4a94909-0da5-4317-84eb-53b94b1e2d48 admin admin] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:29:47.198965 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-d4a94909-0da5-4317-84eb-53b94b1e2d48 admin admin] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:29:47.232820 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-d4a94909-0da5-4317-84eb-53b94b1e2d48 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.207827 Aug 19 16:29:47.233345 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 35/70] 10.222.0.55 () {60 vars in 1193 bytes} [Fri Aug 19 16:29:47 2022] GET /compute/v2.1/os-services => generated 794 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:29:48.060088 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-69438d21-7f34-4964-b07d-25914845e414 admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:29:48.061163 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-69438d21-7f34-4964-b07d-25914845e414 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 19 16:29:48.061562 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 36/71] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Aug 19 16:29:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:29:48.253614 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-2e5623df-04e3-40ef-9352-dc8e0b3ef1ee admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:29:48.255939 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:29:48.255939 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: warnings.warn(msg) Aug 19 16:29:48.257070 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-2e5623df-04e3-40ef-9352-dc8e0b3ef1ee admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:29:48.257544 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-2e5623df-04e3-40ef-9352-dc8e0b3ef1ee admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:29:48.257969 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-2e5623df-04e3-40ef-9352-dc8e0b3ef1ee admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:29:48.258742 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-2e5623df-04e3-40ef-9352-dc8e0b3ef1ee admin admin] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:29:48.259112 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-2e5623df-04e3-40ef-9352-dc8e0b3ef1ee admin admin] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:29:48.259523 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-2e5623df-04e3-40ef-9352-dc8e0b3ef1ee admin admin] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:29:48.278843 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-2e5623df-04e3-40ef-9352-dc8e0b3ef1ee admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077324 Aug 19 16:29:48.279323 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 36/72] 10.222.0.55 () {60 vars in 1193 bytes} [Fri Aug 19 16:29:48 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:29:59.544703 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-69438d21-7f34-4964-b07d-25914845e414 admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:29:59.545929 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-69438d21-7f34-4964-b07d-25914845e414 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001655 Aug 19 16:29:59.546337 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 37/73] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Aug 19 16:29:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:29:59.688944 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writing DB stats nova_cell0:SELECT=4 {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:59.689667 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writing DB stats nova_cell1:SELECT=4 {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:59.690585 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writing DB stats nova_api:SELECT=8 {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:29:59.739871 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-a384551a-53d1-4a2d-abfd-0522d5b58c3b admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:29:59.742245 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:29:59.742245 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: warnings.warn(msg) Aug 19 16:29:59.743352 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-a384551a-53d1-4a2d-abfd-0522d5b58c3b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:29:59.743830 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-a384551a-53d1-4a2d-abfd-0522d5b58c3b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:29:59.744256 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-a384551a-53d1-4a2d-abfd-0522d5b58c3b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:29:59.745107 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-a384551a-53d1-4a2d-abfd-0522d5b58c3b admin admin] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:29:59.745557 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-a384551a-53d1-4a2d-abfd-0522d5b58c3b admin admin] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:29:59.745977 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-a384551a-53d1-4a2d-abfd-0522d5b58c3b admin admin] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:29:59.771370 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-a384551a-53d1-4a2d-abfd-0522d5b58c3b admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.087465 Aug 19 16:29:59.771935 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 37/74] 10.222.0.55 () {60 vars in 1193 bytes} [Fri Aug 19 16:29:59 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:30:00.597418 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: DEBUG nova.api.openstack.wsgi [None req-69438d21-7f34-4964-b07d-25914845e414 admin admin] Calling method '>' {{(pid=105532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:30:00.598444 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: INFO nova.api.openstack.requestlog [None req-69438d21-7f34-4964-b07d-25914845e414 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 19 16:30:00.598845 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: [pid: 105532|app: 0|req: 38/75] 10.222.0.55 () {56 vars in 1074 bytes} [Fri Aug 19 16:30:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:30:00.789363 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-a094a25f-f5a5-4a7c-86b4-d65ce6e658dc admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:30:00.791695 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:30:00.791695 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: warnings.warn(msg) Aug 19 16:30:00.792897 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-a094a25f-f5a5-4a7c-86b4-d65ce6e658dc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:30:00.793370 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-a094a25f-f5a5-4a7c-86b4-d65ce6e658dc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:30:00.793789 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-a094a25f-f5a5-4a7c-86b4-d65ce6e658dc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:30:00.794494 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-a094a25f-f5a5-4a7c-86b4-d65ce6e658dc admin admin] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:30:00.794935 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-a094a25f-f5a5-4a7c-86b4-d65ce6e658dc admin admin] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:30:00.795348 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-a094a25f-f5a5-4a7c-86b4-d65ce6e658dc admin admin] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:30:00.816205 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-a094a25f-f5a5-4a7c-86b4-d65ce6e658dc admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.078450 Aug 19 16:30:00.816765 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 38/76] 10.222.0.55 () {60 vars in 1193 bytes} [Fri Aug 19 16:30:00 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:31:02.007998 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: Fri Aug 19 16:31:02 2022 - graceful shutdown triggered... Aug 19 16:31:02.007487 dv-cinder-831247-23-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 19 16:31:02.008930 dv-cinder-831247-23-iscsi devstack@n-api.service[105532]: Gracefully killing worker 2 (pid: 105532)... Aug 19 16:31:02.009302 dv-cinder-831247-23-iscsi devstack@n-api.service[105531]: Gracefully killing worker 1 (pid: 105531)... Aug 19 16:31:03.007944 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: worker 1 buried after 1 seconds Aug 19 16:31:03.008150 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: worker 2 buried after 1 seconds Aug 19 16:31:03.008150 dv-cinder-831247-23-iscsi devstack@n-api.service[105530]: goodbye to uWSGI. Aug 19 16:31:03.009594 dv-cinder-831247-23-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 19 16:31:03.010146 dv-cinder-831247-23-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 19 16:31:03.012951 dv-cinder-831247-23-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 19 16:31:03.023869 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 19 16:31:03.026794 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 19 16:31:03 2022] *** Aug 19 16:31:03.026953 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 16:31:03.027086 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 16:31:03.027218 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: nodename: dv-cinder-831247-23-iscsi Aug 19 16:31:03.027330 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: machine: x86_64 Aug 19 16:31:03.027440 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: clock source: unix Aug 19 16:31:03.027549 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: pcre jit disabled Aug 19 16:31:03.027663 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: detected number of CPU cores: 4 Aug 19 16:31:03.027773 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: current working directory: / Aug 19 16:31:03.027888 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: detected binary path: /usr/bin/uwsgi-core Aug 19 16:31:03.028024 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: your processes number limit is 47680 Aug 19 16:31:03.028024 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: your memory page size is 4096 bytes Aug 19 16:31:03.028024 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: detected max file descriptor number: 2048 Aug 19 16:31:03.028024 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: lock engine: pthread robust mutexes Aug 19 16:31:03.028338 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: thunder lock: enabled Aug 19 16:31:03.028407 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 19 16:31:03.028482 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 19 16:31:03.068535 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: Python main interpreter initialized at 0x55aa1b8629c0 Aug 19 16:31:03.068535 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: python threads support enabled Aug 19 16:31:03.068535 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: your server socket listen backlog is limited to 100 connections Aug 19 16:31:03.068535 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: your mercy for graceful operations on workers is 90 seconds Aug 19 16:31:03.068967 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 16:31:03.068967 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: *** Operational MODE: preforking *** Aug 19 16:31:03.069239 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: *** uWSGI is running in multiple interpreter mode *** Aug 19 16:31:03.069239 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: spawned uWSGI master process (pid: 127272) Aug 19 16:31:03.069448 dv-cinder-831247-23-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 19 16:31:03.070333 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: spawned uWSGI worker 1 (pid: 127284, cores: 1) Aug 19 16:31:03.070466 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: spawned uWSGI worker 2 (pid: 127285, cores: 1) Aug 19 16:31:03.070551 dv-cinder-831247-23-iscsi devstack@n-api.service[127272]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 16:31:03.738088 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 19 16:31:03.745067 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 19 16:31:04.901092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 16:31:04.901092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: from cryptography.utils import int_from_bytes Aug 19 16:31:04.901857 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 16:31:04.901857 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: from cryptography.utils import int_from_bytes Aug 19 16:31:04.902235 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 16:31:04.902235 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: from cryptography.utils import int_from_bytes Aug 19 16:31:04.902691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 16:31:04.902691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: from cryptography.utils import int_from_bytes Aug 19 16:31:07.317161 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 16:31:07.318104 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 16:31:07.318648 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 16:31:07.319030 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 16:31:07.319290 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 16:31:07.319686 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.320019 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.320347 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.320674 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.321038 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.321353 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.321682 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.322007 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.322344 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.322607 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.322927 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.323254 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-23-iscsi {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.323578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.324050 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.324368 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.324693 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.325029 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.325399 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.325671 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.326210 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.328253 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.328253 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.328253 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.328253 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.328596 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.328673 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 16:31:07.329122 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.329209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 16:31:07.329308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.329627 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.329734 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 16:31:07.329816 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.329893 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 16:31:07.330103 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 16:31:07.330328 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.330565 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.330779 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-23-iscsi {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.330779 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.331202 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.331411 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.331632 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.331842 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.332059 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.332059 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.332488 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.332706 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.332931 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.333149 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.333368 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.333590 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.333821 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.333821 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.334221 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.334221 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.334642 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.334863 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.335050 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.335234 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-23-iscsi {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.335411 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.335600 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.335786 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.335786 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.336078 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.336236 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.336380 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.336558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.336721 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.336911 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.337065 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.337215 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.337365 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.337763 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.337956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.338110 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.338110 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.338405 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.338564 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.338717 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.338869 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.339011 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.339161 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.340026 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.340188 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.340347 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.340535 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.340718 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.340908 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.341055 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.341205 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.341358 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.341508 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.341819 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.341969 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.342119 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.342275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.342429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.342573 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.342573 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.342860 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-23-iscsi {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.343012 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.343166 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.343316 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.343504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.343660 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.344409 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.344579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.344735 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.344735 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.345051 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.345204 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.345347 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.345347 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.345693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.345848 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.346009 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.346224 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.346377 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.346535 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.346689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.346854 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.347574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.347738 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.347892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.348056 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.348206 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.348351 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.348503 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.348646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.348821 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.348981 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.349131 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.349282 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.349464 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.350285 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.350499 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.350648 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.350817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.350972 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.351125 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.351267 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.351419 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.351568 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.351718 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.351989 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.352140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.352297 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.352447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.352603 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.352783 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.352944 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.353105 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.353260 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.353403 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.353546 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.353694 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.353837 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.353987 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.354136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.354285 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.354428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.354587 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.354740 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.354891 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.355045 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.355195 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.355337 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.355496 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.355647 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.355854 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.355997 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.356146 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.356289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.356437 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.356599 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.356800 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.356964 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.357115 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.357344 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.357535 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.357691 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.365880 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.366079 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.366244 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.366393 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.366556 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.366726 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.366895 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.367039 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.369283 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.369559 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.369727 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.369885 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.370040 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.370196 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.370356 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.370501 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.370652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.370801 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.370959 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.371102 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.371259 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.371413 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.371565 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.371708 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.371852 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.371995 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.371995 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.372276 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.372431 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.372582 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.372732 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.372933 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.373588 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.373744 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.373949 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.373949 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.374269 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.375509 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.375642 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.375733 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.375808 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.375886 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.375964 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.376063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.376168 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.376262 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.376357 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.376443 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.376532 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.376631 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.376726 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.376842 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.376915 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.376998 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.377096 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.377196 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.377268 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.377357 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.377448 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.377527 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.377623 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.377716 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.377800 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.377890 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.377974 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.378057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.378144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.378235 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.378309 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.378377 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.378445 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.378526 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.378622 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.378708 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.378780 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.378861 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.378969 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.379055 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.379138 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.379230 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.379327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.379421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.379507 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.379596 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.379687 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.379770 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.379856 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.379940 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.380030 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.380120 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.380198 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.380281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.380360 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.380445 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.380445 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.380583 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.380667 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.380770 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.380867 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.380941 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.381009 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.381009 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.381009 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.381009 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.381009 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.381009 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.381009 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.381009 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.381519 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.381519 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.381519 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.381519 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.381519 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.381519 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.381965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.382058 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.382058 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.382218 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.382309 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.382392 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.382473 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.382568 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.382653 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.382730 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.382810 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.382886 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.382985 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.382985 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.383145 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.383240 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.383325 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.383408 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.383490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.383572 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.383666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.383666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.383824 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.383824 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.383824 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.383824 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.383824 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.383824 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.383824 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.383824 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.384411 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.384411 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.384575 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.384664 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.388819 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.389560 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.389717 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.389882 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.389882 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.390179 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.390324 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.390324 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.390594 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.390746 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.390898 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 16:31:07.391066 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.391217 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.391361 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.391565 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.391714 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.391856 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.391998 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.392147 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.392290 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.392448 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.392601 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.392601 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.393075 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.393218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.393369 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.393636 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.393792 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.393935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.394085 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.394243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.394392 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.394549 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.394693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.394834 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.394992 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.395511 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.395742 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.395890 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.396040 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.396229 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.396385 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.396679 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.396944 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.397094 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.397094 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.397371 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.397514 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.397701 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.397869 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.398013 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.398256 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.398413 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.398556 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.398699 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.398850 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.398999 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.399143 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.399285 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.399434 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.399586 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.399852 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.399996 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.400152 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.400303 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.400447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.400599 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.400764 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.400922 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.401070 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.401070 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.401351 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.401515 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.401667 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.401869 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.402023 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.402172 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.402327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.402489 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.402638 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.402788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.402936 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.403084 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.403241 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.403396 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.403545 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.403736 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.403929 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.404582 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.404791 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.404951 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.405112 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.405300 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.405774 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.405973 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.406142 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.406342 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.406498 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.406674 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.406932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.407160 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.407324 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.407475 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.407624 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.407815 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.408026 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.408191 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.408468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.408739 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.408965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.409121 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.409281 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.409452 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.409611 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.409772 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.409928 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.410139 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.410290 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.410448 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.410605 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.410754 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.410902 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.411085 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.411241 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.411398 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.411560 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.411708 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.411863 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.412052 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.412206 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.412369 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.412518 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.412673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.413086 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.413283 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.413446 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.413596 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.413752 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.413912 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.414060 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.414215 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.414375 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.414524 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.414672 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.414827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.414984 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.415141 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.415336 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.415495 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.416003 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.416164 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.416375 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.416547 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.416712 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.416933 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.417172 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.417419 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.417585 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.417758 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.417758 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.417758 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.418306 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.418471 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.418762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.419007 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.419168 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.419326 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.419513 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.419663 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.419811 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.420583 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.420913 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.421076 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.421227 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.421387 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.421536 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.421711 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.421872 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.422021 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.422168 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.422324 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.422324 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.422630 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.422781 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.422928 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.423076 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.423224 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.423380 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.423573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.423883 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.424072 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.424072 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.424072 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.424072 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.424817 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.425031 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.425195 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.425354 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.425511 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.425687 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.426083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.426273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.426488 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.426641 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.426810 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.426963 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.427111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.427349 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.427615 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.427780 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.428009 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.428168 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.428320 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.428468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.428656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.429026 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.429264 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.429426 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.429587 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.429743 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.429893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.430041 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.430203 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.430360 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.430509 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.430657 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.430805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.430973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.431132 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.431289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.431445 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.431445 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.431770 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.431770 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.432103 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.432103 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.432399 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.432555 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.432705 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.432705 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.433049 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.433208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.433365 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.433514 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.433662 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.433820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.434057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.434211 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.434400 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.434554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.434712 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.434869 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.435018 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.435178 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.435328 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.435476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.437833 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.438005 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.438173 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.438361 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.438516 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.438674 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.438832 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.439007 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.439287 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.439525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.439689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.439839 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.439987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.440172 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.440339 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.440489 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.440638 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.440806 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.440974 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.441132 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.441290 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.441454 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.441612 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.441761 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.441761 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.442051 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.442208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.442363 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.442552 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.442709 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.442866 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.443014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.443175 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.443325 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.443486 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.443632 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.443782 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.443942 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.444185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.444371 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.444524 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.444730 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.445003 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.445165 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.445315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.445470 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.445642 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.445801 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.445958 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.446108 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.446264 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.446715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.446887 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.447047 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.447047 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.447331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.447504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.447815 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.447815 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.448139 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.448301 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.448452 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.448608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.448774 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.448944 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.449095 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.449287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.449555 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.449941 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.450108 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.450259 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.450408 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.450570 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.450719 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.450876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.451233 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.451401 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.451574 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.451728 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.451879 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.452014 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.452169 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.452312 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.452483 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.452618 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.452793 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.452793 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.453079 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.453221 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.453368 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.453505 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.453652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.453803 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.453951 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.454088 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.454246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.454341 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.454426 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.454553 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.454640 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.454723 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.454812 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.454896 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.454985 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.455081 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.455165 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.455255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.455338 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.455428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.455511 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.455607 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.455691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.455773 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.455862 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.455945 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.456040 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.456131 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.456284 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.456372 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.456455 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.456585 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.456998 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.457093 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.457190 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.457282 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.457544 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.457639 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.457752 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.457857 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.457944 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.458027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.458113 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.458196 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.458293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.458388 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.458583 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.458677 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.458760 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.458857 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.458948 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.459032 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.459115 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.459198 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.459288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.459452 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.459554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.459638 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.459721 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.459810 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.459895 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.459987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.459987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.460156 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.460254 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.460254 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.460414 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.460525 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.460609 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.460716 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.460827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.460921 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.461014 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.461099 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.461189 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.461273 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.461361 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.461451 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.461548 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.461640 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.461724 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.461724 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.461894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.461986 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.462069 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.462151 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.462232 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.462326 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.462417 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.462765 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.462852 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.462941 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.463025 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.463183 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.463271 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.463354 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.463435 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.463527 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.463612 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.463702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.463799 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.463884 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.463966 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.464055 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.464144 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.464246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.464330 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.464408 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.464408 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.464408 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.464408 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.464689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.464883 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.464991 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.465077 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.465077 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.465253 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.465344 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.465428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.465519 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.465609 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.465858 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.465958 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.466043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.466124 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.466206 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.466295 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.466378 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.466473 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.466557 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.466746 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.467099 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.467197 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.467389 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.467481 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.467553 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.467621 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.467690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.467759 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.467902 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.468041 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.468133 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.468264 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.468363 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.468454 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.468547 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.468647 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.468746 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.468911 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.469012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.469104 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.469201 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.469286 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.469368 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.469449 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.469531 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.469626 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.469710 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.469792 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.469873 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.469873 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.470035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.470035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.470242 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.470242 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.470403 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.470486 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.470575 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.470671 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.470761 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.470851 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.470933 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.471015 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.471102 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.471193 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.471283 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.471365 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.471446 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.471527 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.471608 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.471698 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.471782 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.471864 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.471952 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.472042 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.472137 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.472221 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.472343 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.472454 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.472621 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.472768 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.472950 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.473044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.473124 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.473195 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.473298 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.473384 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.473469 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.473547 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.473624 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.473694 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.473770 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.473863 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.473942 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.474013 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.474088 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.474165 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.474234 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.474316 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.474397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.474475 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.474552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.474628 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.474628 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.474806 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.474907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.474983 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.475060 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.475130 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.475130 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.475130 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.475326 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.475395 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.475487 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.475565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.475635 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.475712 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.475790 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.475860 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.475942 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.476112 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.476211 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.476398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.476488 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.476709 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.476816 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.477124 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.477244 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.477504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.477820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.478135 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.478472 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.478664 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.478795 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.478997 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.479145 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.479329 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.479464 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.479669 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.479768 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.479989 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.480087 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.480306 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.480397 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.480623 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.480721 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.480983 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.481155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.481286 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.481482 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.481615 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.481798 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.482029 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.482175 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.482342 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.483034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.483180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.483259 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.483573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.483706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.483976 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.484089 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.484194 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.484280 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.484521 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.484622 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.484867 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.485054 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.485205 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.485329 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.485515 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.485624 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.485833 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.485937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.486148 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.486300 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.486465 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.486565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.486785 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.486886 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.487107 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.487246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.487422 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.487525 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.487731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.487836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.488048 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.488145 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.488373 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.488475 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.488690 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.488859 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.489040 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.489145 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.489362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.489453 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.489678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.489770 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.489996 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.490094 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.490313 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.490442 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.490626 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.490718 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.490960 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.491058 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.491278 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.491371 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.491589 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.491681 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.491901 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.492034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.492212 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.492314 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.492529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.492619 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.492862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.492974 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.493187 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.493307 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.493507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.493599 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.493822 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.493914 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.494135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.494289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.494440 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.494547 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.494767 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.494869 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.495078 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.495177 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.495408 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.495513 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.495727 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.495828 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.496055 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.496153 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.496378 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.496483 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.496684 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.496908 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.497058 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.497166 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.497461 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.497590 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.497702 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.497794 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.497964 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.498087 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.498851 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.498982 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.499159 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.499331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.499471 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.499564 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.499782 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.499880 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.500113 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.500250 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.500428 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.500557 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.500743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.500924 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.501102 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.501196 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.501431 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.501530 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.501757 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.501859 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.502079 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.502206 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.502406 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.502533 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.502714 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.502819 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.503023 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.503118 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.503334 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.503450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.503641 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.503780 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.503948 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.504094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.504258 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.504422 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.504569 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.504737 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.504898 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.505094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.505204 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.505426 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.505519 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.505750 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.505842 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.506073 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.506173 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.506387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.506492 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.506717 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.506811 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.507024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.507124 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.507342 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.507539 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.507657 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.507736 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.507973 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.508079 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.508280 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.508382 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.508613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.508714 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.508958 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.509051 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.509287 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.509415 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.509610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.509711 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.509932 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.510032 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.510255 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.510353 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.510568 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.510710 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.510881 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.510973 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.511199 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.511297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.511507 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.511597 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.511820 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.511910 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.512138 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.512229 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.512454 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.512545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.512786 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.512894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.513106 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.513346 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.513437 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.513714 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.513813 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.514039 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.514149 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.514365 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.514490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.514684 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.514789 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.515006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.515100 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.515322 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.515411 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.515637 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.515735 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.515951 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.516043 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.516263 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.516362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.516574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.516674 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.516912 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.517018 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.517245 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.517334 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.517566 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.517701 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.517883 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.517986 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.518208 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.518317 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.518532 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.518633 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.518846 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.518935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.519164 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.519254 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.519502 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.519607 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.519830 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.519929 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.520139 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.520230 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.520460 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.520552 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.520783 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.520876 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.521099 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.521203 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.521413 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.521510 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.521720 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.521809 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.522029 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.522129 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.522338 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.522438 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.522651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.522745 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.522962 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.523063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.523269 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.523368 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.523578 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.523668 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.523902 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.524001 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.524218 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.524365 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.524535 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.524660 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.524878 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.524993 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.525190 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.525291 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.525502 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.525594 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.525814 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.526019 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.526160 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.526339 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.526471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.526675 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.526809 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.527003 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.527126 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.527330 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.527456 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.527670 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.527782 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.527966 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.528092 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.528301 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.528418 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.528615 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.528744 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.528952 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.529092 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.529267 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.529496 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.529662 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.529768 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.529973 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.530205 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.530304 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.530534 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.530633 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.530859 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.530958 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.531185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.531276 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.531504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.531749 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.532040 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.532138 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.532391 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.532490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.532710 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.532834 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.533061 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.533159 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.533386 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.533475 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.533702 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.533803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.534012 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.534113 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.534331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.534429 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.534641 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.534754 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.534954 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.535077 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.535272 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.535373 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.535588 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.535807 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.536233 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.536318 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.536409 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.536504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.536589 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.536667 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.536805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.536912 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.537114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.537335 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.537433 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.537526 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.537790 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.537901 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.538039 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.538175 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.538354 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.538491 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.538661 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.538815 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.538967 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.539137 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.539281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.539982 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.540104 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.540201 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.540296 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.540381 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.540471 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.540556 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.540639 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.540735 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.540862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.541035 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.541144 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.541352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.541451 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.541674 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.541768 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.541988 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.542084 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.542296 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.542388 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.542608 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.542708 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.542913 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.543011 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.543237 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.543337 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.543544 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.543643 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.543885 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.543982 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.544205 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.544414 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.544507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.544765 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.545488 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.545806 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.546045 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.546158 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.546244 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.546463 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.546556 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.546785 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.546877 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.547113 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.547324 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.547453 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.547660 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.547773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.547986 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.548135 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.548318 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.548461 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.548657 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.548794 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.548994 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.549095 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.549303 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.549394 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.549612 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.549711 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.549940 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.550039 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.550253 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.550352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.550564 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.550657 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.550877 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.551116 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.551207 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.551477 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.551575 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.551787 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.551878 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.552102 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.552201 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.552416 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.552507 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.552778 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.552872 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.553094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.553187 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.553418 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.553513 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.553732 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.553826 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.554045 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.554135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.554354 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.554443 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.554672 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.554765 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.554983 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.555074 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.555298 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.555402 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.555618 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.555715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.555938 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.556032 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.556251 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.556350 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.556562 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.556652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.556900 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.556998 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.557214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.557319 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.557527 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.557626 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.557837 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.557932 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.558152 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.558264 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.558568 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.558681 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.558767 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.558857 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.559083 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.559175 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.559395 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.559487 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.559705 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.559803 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.560037 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.560139 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.560334 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.560426 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.561303 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.561435 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.561635 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.561758 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.561950 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.562044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.562275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.562382 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.562591 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.562683 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.562923 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.563014 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.563253 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.563352 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.563569 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.563660 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.563894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.563992 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.564204 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.564305 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.564515 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.564608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.564854 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.564987 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.565170 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.565313 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.565490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.565637 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.565802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.565993 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.566116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.566320 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.566414 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.566703 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.566865 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.567011 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.567250 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.567349 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.567533 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.567748 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.567878 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.567978 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.568209 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.568343 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.568519 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.568613 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.568856 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.568969 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.569166 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.569257 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.569475 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.569578 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.569784 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.569886 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.570093 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.570191 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.570408 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.570507 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.570716 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.570816 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.571025 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.571116 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.571334 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.571490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.571640 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.571741 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.571947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.572039 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.572263 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.572359 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.572583 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.572683 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.572927 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.573020 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.573245 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.573348 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.573561 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.573661 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.573881 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.573972 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.574193 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.574290 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.574520 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.574613 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.574844 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.574935 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.575165 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.575306 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.575480 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.575579 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.575802 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.575891 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.576118 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.576237 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.576470 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.576562 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.576850 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.576946 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.577201 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.577303 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.577516 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.577608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.577836 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.577939 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.578168 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.578421 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.578515 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.578638 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.578798 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.578931 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.579124 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.579218 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.579445 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.579536 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.579769 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.579867 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.580089 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.580224 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.580423 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.580560 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.580734 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.580894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.581072 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.581180 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.581388 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.581479 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.581698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.581807 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.582012 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.582184 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.582321 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.582441 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.582634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.582743 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.582947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.583046 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.583262 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.583388 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.583587 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.583717 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.583907 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.584014 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.584221 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.584312 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.584547 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.584677 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.584866 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.584955 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.585193 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.585283 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.585507 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.585604 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.585825 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.585916 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.586138 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.586230 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.586450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.586550 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.586762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.586862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.587075 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.587179 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.587392 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.587743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.587969 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.588070 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.588213 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 16:31:07.588313 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.588580 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.588912 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.589224 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.589536 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.589855 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.590168 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.590482 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.590794 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.591105 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.591417 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.591754 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.592120 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.592443 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.592791 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.593117 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.593447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.593774 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.594104 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.594434 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.594760 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.595077 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.595417 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.595736 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.596056 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.596377 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.596694 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.597039 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.597355 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.597692 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.598025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.598337 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.598667 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.598996 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.599324 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.599646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.599966 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.600301 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.600620 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.600966 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.601286 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.601604 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.601923 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.602247 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.602565 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.602885 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.603211 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.603537 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.603868 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.604198 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.604514 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.604870 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.605203 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.605559 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.605886 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.606234 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.606570 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.606892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.607215 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.608135 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 16:31:07.608536 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 16:31:07.650456 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO dbcounter [None req-f8ff67a4-bc67-4198-9d87-6f61edddcd2d None None] Registered counter for database nova_api Aug 19 16:31:07.670769 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO dbcounter [None req-fd94dda8-54f4-4dd7-bca7-4eb839bea11e None None] Registered counter for database nova_api Aug 19 16:31:07.672378 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_db.sqlalchemy.engines [None req-f8ff67a4-bc67-4198-9d87-6f61edddcd2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 16:31:07.678944 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writer thread running {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 16:31:07.692089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_db.sqlalchemy.engines [None req-fd94dda8-54f4-4dd7-bca7-4eb839bea11e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 16:31:07.698674 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writer thread running {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 16:31:07.734985 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.context [None req-f8ff67a4-bc67-4198-9d87-6f61edddcd2d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30(cell1) {{(pid=127285) load_cells /opt/stack/nova/nova/context.py:464}} Aug 19 16:31:07.739004 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f8ff67a4-bc67-4198-9d87-6f61edddcd2d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:31:07.739478 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f8ff67a4-bc67-4198-9d87-6f61edddcd2d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:31:07.741056 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f8ff67a4-bc67-4198-9d87-6f61edddcd2d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:31:07.741812 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f8ff67a4-bc67-4198-9d87-6f61edddcd2d None None] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:31:07.742264 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f8ff67a4-bc67-4198-9d87-6f61edddcd2d None None] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:31:07.744235 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f8ff67a4-bc67-4198-9d87-6f61edddcd2d None None] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:31:07.746304 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO dbcounter [None req-f8ff67a4-bc67-4198-9d87-6f61edddcd2d None None] Registered counter for database nova_cell0 Aug 19 16:31:07.751172 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO dbcounter [None req-f8ff67a4-bc67-4198-9d87-6f61edddcd2d None None] Registered counter for database nova_cell1 Aug 19 16:31:07.755075 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.context [None req-fd94dda8-54f4-4dd7-bca7-4eb839bea11e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30(cell1) {{(pid=127284) load_cells /opt/stack/nova/nova/context.py:464}} Aug 19 16:31:07.758518 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_db.sqlalchemy.engines [None req-f8ff67a4-bc67-4198-9d87-6f61edddcd2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 16:31:07.759246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fd94dda8-54f4-4dd7-bca7-4eb839bea11e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:31:07.759654 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fd94dda8-54f4-4dd7-bca7-4eb839bea11e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:31:07.761263 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_db.sqlalchemy.engines [None req-f8ff67a4-bc67-4198-9d87-6f61edddcd2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 16:31:07.761374 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fd94dda8-54f4-4dd7-bca7-4eb839bea11e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:31:07.762042 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fd94dda8-54f4-4dd7-bca7-4eb839bea11e None None] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:31:07.762500 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fd94dda8-54f4-4dd7-bca7-4eb839bea11e None None] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:31:07.764562 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fd94dda8-54f4-4dd7-bca7-4eb839bea11e None None] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:31:07.766610 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO dbcounter [None req-fd94dda8-54f4-4dd7-bca7-4eb839bea11e None None] Registered counter for database nova_cell0 Aug 19 16:31:07.767329 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writer thread running {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 16:31:07.768635 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writer thread running {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 16:31:07.770770 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO dbcounter [None req-fd94dda8-54f4-4dd7-bca7-4eb839bea11e None None] Registered counter for database nova_cell1 Aug 19 16:31:07.778163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_db.sqlalchemy.engines [None req-fd94dda8-54f4-4dd7-bca7-4eb839bea11e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 16:31:07.780938 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_db.sqlalchemy.engines [None req-fd94dda8-54f4-4dd7-bca7-4eb839bea11e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 16:31:07.787548 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writer thread running {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 16:31:07.789635 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writer thread running {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 16:31:07.919543 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO dbcounter [None req-f8ff67a4-bc67-4198-9d87-6f61edddcd2d None None] Registered counter for database nova_cell0 Aug 19 16:31:07.927063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_db.sqlalchemy.engines [None req-f8ff67a4-bc67-4198-9d87-6f61edddcd2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 16:31:07.932192 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writer thread running {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 16:31:07.938662 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO dbcounter [None req-fd94dda8-54f4-4dd7-bca7-4eb839bea11e None None] Registered counter for database nova_cell0 Aug 19 16:31:07.947576 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_db.sqlalchemy.engines [None req-fd94dda8-54f4-4dd7-bca7-4eb839bea11e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 16:31:07.952849 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writer thread running {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 16:31:08.256006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: WARNING keystonemiddleware.auth_token [None req-f8ff67a4-bc67-4198-9d87-6f61edddcd2d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 16:31:08.263477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: WARNING keystonemiddleware.auth_token [None req-f8ff67a4-bc67-4198-9d87-6f61edddcd2d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 16:31:08.272440 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: WARNING keystonemiddleware.auth_token [None req-fd94dda8-54f4-4dd7-bca7-4eb839bea11e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 16:31:08.279844 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: WARNING keystonemiddleware.auth_token [None req-fd94dda8-54f4-4dd7-bca7-4eb839bea11e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 16:31:08.618098 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: WARNING keystonemiddleware.auth_token [None req-f8ff67a4-bc67-4198-9d87-6f61edddcd2d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 16:31:08.624716 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: WARNING keystonemiddleware.auth_token [None req-f8ff67a4-bc67-4198-9d87-6f61edddcd2d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 16:31:08.627045 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: WARNING keystonemiddleware.auth_token [None req-fd94dda8-54f4-4dd7-bca7-4eb839bea11e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 16:31:08.630111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aa1b8629c0 pid: 127285 (default app) Aug 19 16:31:08.633101 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: WARNING keystonemiddleware.auth_token [None req-fd94dda8-54f4-4dd7-bca7-4eb839bea11e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 16:31:08.638579 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aa1b8629c0 pid: 127284 (default app) Aug 19 16:31:45.438238 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6458d10a-d931-4016-9756-4245bd35117b tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] Calling method '.version_select at 0x7fb020116280>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:31:45.480184 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=3 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:45.481187 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=3 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:45.482536 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=3 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:45.484329 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=3 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:46.210911 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6458d10a-d931-4016-9756-4245bd35117b tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/3a86365d-98c3-4970-a443-e1048c4798f2" status: 200 len: 351 microversion: 2.1 time: 1.159431 Aug 19 16:31:46.219412 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 1/1] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Aug 19 16:31:45 2022] GET /compute/v2.1/os-volumes/3a86365d-98c3-4970-a443-e1048c4798f2 => generated 351 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:31:48.547439 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-cff8f430-3e1d-4006-a773-a616ab8f24ab tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] Calling method '.version_select at 0x7fb020118280>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:31:48.611921 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=3 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:48.617109 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=3 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:48.618142 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=3 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:48.619049 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=3 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:31:49.323344 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-cff8f430-3e1d-4006-a773-a616ab8f24ab tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/b69e0100-2342-4e4d-a753-7c4ef78566eb" status: 200 len: 350 microversion: 2.1 time: 1.121229 Aug 19 16:31:49.324285 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 1/2] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Aug 19 16:31:48 2022] GET /compute/v2.1/os-volumes/b69e0100-2342-4e4d-a753-7c4ef78566eb => generated 350 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:31:50.995520 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-07d0a1fb-53ab-4445-92b9-41d15e129003 tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] Calling method '.version_select at 0x7fb01fef05e0>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:31:51.102437 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-07d0a1fb-53ab-4445-92b9-41d15e129003 tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/0a2458db-ccf3-4e53-87c1-3417b31d746b" status: 200 len: 351 microversion: 2.1 time: 0.112221 Aug 19 16:31:51.103116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 2/3] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Aug 19 16:31:50 2022] GET /compute/v2.1/os-volumes/0a2458db-ccf3-4e53-87c1-3417b31d746b => generated 351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:31:51.118916 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2d7f0bf4-0f13-4b37-b33f-dc65ea87689a tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] Calling method '.version_select at 0x7fb01feee310>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:31:51.280425 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2d7f0bf4-0f13-4b37-b33f-dc65ea87689a tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.166953 Aug 19 16:31:51.281269 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 2/4] 10.222.0.55 () {58 vars in 1134 bytes} [Fri Aug 19 16:31:51 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:31:51.304223 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-25dbf177-1c2e-4f12-b337-5594cf5f1c07 tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] Calling method '.version_select at 0x7fb01fef0670>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:31:51.504941 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-25dbf177-1c2e-4f12-b337-5594cf5f1c07 tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.210651 Aug 19 16:31:51.505878 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 3/5] 10.222.0.55 () {58 vars in 1149 bytes} [Fri Aug 19 16:31:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:31:51.520800 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f9f888f0-dfc0-4de4-9493-17dee1a5dfff tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] Calling method '.version_select at 0x7fb01feb4160>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:31:51.837243 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f9f888f0-dfc0-4de4-9493-17dee1a5dfff tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.320117 Aug 19 16:31:51.837824 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 3/6] 10.222.0.55 () {58 vars in 1134 bytes} [Fri Aug 19 16:31:51 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:31:51.851757 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-55797bbf-edeb-4f4f-bd22-569655de4d9b tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] Calling method '.version_select at 0x7fb01fef0ee0>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:31:52.111296 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-55797bbf-edeb-4f4f-bd22-569655de4d9b tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.263820 Aug 19 16:31:52.116697 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 4/7] 10.222.0.55 () {58 vars in 1167 bytes} [Fri Aug 19 16:31:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:31:52.144316 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-642287f3-33d3-43a2-9053-a74483dde44c tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] Calling method '.version_select at 0x7fb01feb4940>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:31:52.383109 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-642287f3-33d3-43a2-9053-a74483dde44c tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.253834 Aug 19 16:31:52.383692 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 4/8] 10.222.0.55 () {58 vars in 1170 bytes} [Fri Aug 19 16:31:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:31:52.405278 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b1500f93-f9f4-4e23-b063-b80f1511db1f tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] Calling method '.version_select at 0x7fb01fec8820>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:31:52.633857 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b1500f93-f9f4-4e23-b063-b80f1511db1f tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.237858 Aug 19 16:31:52.635000 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 5/9] 10.222.0.55 () {58 vars in 1155 bytes} [Fri Aug 19 16:31:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:31:52.651044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-5fa35572-2cc7-4e4c-930f-a124c4231edd tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] Calling method '.version_select at 0x7fb01fece280>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:31:52.807088 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-5fa35572-2cc7-4e4c-930f-a124c4231edd tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.161577 Aug 19 16:31:52.808034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 5/10] 10.222.0.55 () {58 vars in 1188 bytes} [Fri Aug 19 16:31:52 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:31:52.825570 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2089943e-f6cd-43fa-955f-7d42d2143bf6 tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] Calling method '.version_select at 0x7fb01fecfa60>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:31:53.056052 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2089943e-f6cd-43fa-955f-7d42d2143bf6 tempest-VolumesTestJSON-1032248183 tempest-VolumesTestJSON-1032248183-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.236124 Aug 19 16:31:53.057155 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 6/11] 10.222.0.55 () {58 vars in 1155 bytes} [Fri Aug 19 16:31:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:31:57.171838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-0a9628ab-2bb3-4ce8-b07a-fbc678eee5f6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Action: 'create', calling method: .version_select at 0x7fb01fece8b0>, body: {"keypair": {"name": "tempest-keypair-822974724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2sCLyi1wCj3t8OSc1oZRsrJUQZk6bVmms16GuGQP46DM5+K0tww6cSpnk7Lls5RzFPZdsZSrl/wFApUEbnFSeio6krt2eCkykf2sHAp8I6GUBO8JHzE7VpeZ9OuPsnCQ=="}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:31:57.270453 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-0a9628ab-2bb3-4ce8-b07a-fbc678eee5f6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Getting quotas for project d22d9f4004394e1cbcd0a2afffd114b1. Resources: {'key_pairs'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:31:57.286663 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-0a9628ab-2bb3-4ce8-b07a-fbc678eee5f6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Getting quotas for user e09fd34737af41dc972d806dc3b0705e and project d22d9f4004394e1cbcd0a2afffd114b1. Resources: {'key_pairs'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:31:57.426295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-0a9628ab-2bb3-4ce8-b07a-fbc678eee5f6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.568509 Aug 19 16:31:57.439996 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 6/12] 10.222.0.55 () {62 vars in 1200 bytes} [Fri Aug 19 16:31:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 582 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 19 16:32:01.434261 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-cb3a23fe-90b4-45e8-9e90-bed63b514318 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1404132010", "imageRef": "da4af7b7-e205-4511-ad99-3478c2523f74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "59a32018-c862-4804-a80b-75128ffed9f8"}], "security_groups": [{"name": "tempest-securitygroup--2091699463"}], "key_name": "tempest-keypair-822974724", "user_data": "}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:01.821950 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.network.neutron [None req-cb3a23fe-90b4-45e8-9e90-bed63b514318 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] validate_networks() for [('59a32018-c862-4804-a80b-75128ffed9f8', None, None, None, None, None)] {{(pid=127284) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:32:02.010777 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-19af6676-922c-47f5-880e-437e17485906 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Action: 'create', calling method: .version_select at 0x7fb02088f940>, body: {"keypair": {"name": "tempest-keypair-252349643", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjXt/0j3ilLgk17UfN6dT9BzSackINcbZ8FKdHQB7G7Qsj0KlgVM/QczmrmhmTJEPqK2BIslansHCFLPGVM9Llm2uagNXaMNM+lwL8nm3OvgLjVJ0cqat5Kc6qtoIa8pw=="}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:02.160280 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-19af6676-922c-47f5-880e-437e17485906 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Getting quotas for project 1743538991c8415394ac6cd5aed28d6a. Resources: {'key_pairs'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:32:02.169089 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-19af6676-922c-47f5-880e-437e17485906 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Getting quotas for user 9b0455ae3ec94c929c940df6a0f6687d and project 1743538991c8415394ac6cd5aed28d6a. Resources: {'key_pairs'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:32:02.328774 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-19af6676-922c-47f5-880e-437e17485906 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.294559 Aug 19 16:32:02.341409 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 7/13] 10.222.0.55 () {60 vars in 1159 bytes} [Fri Aug 19 16:32:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:32:03.250935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d25034ca-9903-4ed1-97c3-f1cafd225489 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-557441107", "imageRef": "da4af7b7-e205-4511-ad99-3478c2523f74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:03.420169 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.network.neutron [None req-d25034ca-9903-4ed1-97c3-f1cafd225489 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] validate_networks() for [('b6f514de-28c6-4283-b943-c70fcda5540b', None, None, None, None, None)] {{(pid=127285) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:32:04.299546 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-cb3a23fe-90b4-45e8-9e90-bed63b514318 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Flavor limits 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:32:04.300062 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-cb3a23fe-90b4-45e8-9e90-bed63b514318 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Image limits 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:32:04.300449 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-cb3a23fe-90b4-45e8-9e90-bed63b514318 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Flavor pref 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:32:04.304866 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-cb3a23fe-90b4-45e8-9e90-bed63b514318 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Image pref 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:32:04.305370 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-cb3a23fe-90b4-45e8-9e90-bed63b514318 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:32:04.348245 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cb3a23fe-90b4-45e8-9e90-bed63b514318 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:04.351883 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cb3a23fe-90b4-45e8-9e90-bed63b514318 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:04.352376 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cb3a23fe-90b4-45e8-9e90-bed63b514318 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:04.359177 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cb3a23fe-90b4-45e8-9e90-bed63b514318 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:04.364473 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cb3a23fe-90b4-45e8-9e90-bed63b514318 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:04.364980 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cb3a23fe-90b4-45e8-9e90-bed63b514318 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:04.483513 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-cb3a23fe-90b4-45e8-9e90-bed63b514318 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Getting quotas for project d22d9f4004394e1cbcd0a2afffd114b1. Resources: {'ram', 'cores', 'instances'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:32:04.499399 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-cb3a23fe-90b4-45e8-9e90-bed63b514318 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Getting quotas for user e09fd34737af41dc972d806dc3b0705e and project d22d9f4004394e1cbcd0a2afffd114b1. Resources: {'ram', 'cores', 'instances'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:32:04.536374 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-cb3a23fe-90b4-45e8-9e90-bed63b514318 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Going to run 1 instances... {{(pid=127284) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:32:04.545860 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-cb3a23fe-90b4-45e8-9e90-bed63b514318 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='da4af7b7-e205-4511-ad99-3478c2523f74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:32:04.717840 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-cb3a23fe-90b4-45e8-9e90-bed63b514318 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.286834 Aug 19 16:32:04.719859 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 7/14] 10.222.0.55 () {62 vars in 1188 bytes} [Fri Aug 19 16:32:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 3291 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 19 16:32:04.733580 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-efbc71bc-5695-48be-8b2c-690bc783627a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:04.735273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-efbc71bc-5695-48be-8b2c-690bc783627a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:05.423617 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-efbc71bc-5695-48be-8b2c-690bc783627a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:05.478400 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-efbc71bc-5695-48be-8b2c-690bc783627a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:05.484127 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-efbc71bc-5695-48be-8b2c-690bc783627a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:05.490612 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-efbc71bc-5695-48be-8b2c-690bc783627a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1281 microversion: 2.20 time: 0.759175 Aug 19 16:32:05.494663 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 8/15] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:04 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1281 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:05.774410 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-d25034ca-9903-4ed1-97c3-f1cafd225489 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Flavor limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:32:05.774908 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-d25034ca-9903-4ed1-97c3-f1cafd225489 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Image limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:32:05.775599 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-d25034ca-9903-4ed1-97c3-f1cafd225489 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Flavor pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:32:05.776023 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-d25034ca-9903-4ed1-97c3-f1cafd225489 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Image pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:32:05.776453 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-d25034ca-9903-4ed1-97c3-f1cafd225489 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:32:05.807290 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d25034ca-9903-4ed1-97c3-f1cafd225489 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:05.807786 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d25034ca-9903-4ed1-97c3-f1cafd225489 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:05.815079 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d25034ca-9903-4ed1-97c3-f1cafd225489 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:05.816073 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d25034ca-9903-4ed1-97c3-f1cafd225489 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:05.816613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d25034ca-9903-4ed1-97c3-f1cafd225489 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:05.817093 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d25034ca-9903-4ed1-97c3-f1cafd225489 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:05.967951 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-d25034ca-9903-4ed1-97c3-f1cafd225489 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Getting quotas for project b5638f78ab9440479a209d0023e6d0bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:32:05.991820 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-d25034ca-9903-4ed1-97c3-f1cafd225489 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Getting quotas for user 7936bf23a031418b8ce304aa3bbcf8a2 and project b5638f78ab9440479a209d0023e6d0bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:32:06.045288 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d25034ca-9903-4ed1-97c3-f1cafd225489 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Going to run 1 instances... {{(pid=127285) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:32:06.058389 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d25034ca-9903-4ed1-97c3-f1cafd225489 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='da4af7b7-e205-4511-ad99-3478c2523f74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127285) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:32:06.275891 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d25034ca-9903-4ed1-97c3-f1cafd225489 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.646258 Aug 19 16:32:06.278109 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 8/16] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Aug 19 16:32:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 3649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 16:32:06.293231 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e6962685-f7d7-4ed6-a751-93581c68f52e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:06.294128 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e6962685-f7d7-4ed6-a751-93581c68f52e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:06.490492 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-34c3cfd0-d526-4162-8b65-45e24feaf2ba tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Action: 'create', calling method: .version_select at 0x7fb01e528e50>, body: {"keypair": {"name": "tempest-keypair-1876633714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLR+RQ0q8Ha0gCm6EDGbMOZ4R4tU/x7wOnYDATc/YZyKDLagesPn8QwrV0fBQI6Agz2SJMStuB4Jlp19e4ljWBKWO5wv3Feqd8NmoQza1YttR762/mp9VzCcpm6TAG40Q=="}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:06.553735 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-34c3cfd0-d526-4162-8b65-45e24feaf2ba tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Getting quotas for project e15ca27a2c874997bd01de973a948311. Resources: {'key_pairs'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:32:06.574663 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-34c3cfd0-d526-4162-8b65-45e24feaf2ba tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Getting quotas for user d55dc52ab80642da90f05e74092ffdf8 and project e15ca27a2c874997bd01de973a948311. Resources: {'key_pairs'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:32:06.705286 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-34c3cfd0-d526-4162-8b65-45e24feaf2ba tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.209414 Aug 19 16:32:06.706365 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 9/17] 10.222.0.55 () {60 vars in 1159 bytes} [Fri Aug 19 16:32:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:32:06.717197 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-9d05de98-9f88-4e12-b9fd-3e8c0c2fdcb8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:06.718541 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-9d05de98-9f88-4e12-b9fd-3e8c0c2fdcb8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:06.745447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e6962685-f7d7-4ed6-a751-93581c68f52e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:06.807057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e6962685-f7d7-4ed6-a751-93581c68f52e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1221 microversion: 2.1 time: 0.520471 Aug 19 16:32:06.817876 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 9/18] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:06 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1221 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:07.074807 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-9d05de98-9f88-4e12-b9fd-3e8c0c2fdcb8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:07.087932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-9d05de98-9f88-4e12-b9fd-3e8c0c2fdcb8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:07.092742 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-9d05de98-9f88-4e12-b9fd-3e8c0c2fdcb8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:07.094139 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-9d05de98-9f88-4e12-b9fd-3e8c0c2fdcb8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1281 microversion: 2.20 time: 0.386749 Aug 19 16:32:07.098602 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 10/19] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:06 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1281 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:07.169125 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b30ac97f-4cc6-4723-bd7e-66099a03ea85 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-771543345", "imageRef": "da4af7b7-e205-4511-ad99-3478c2523f74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:07.299963 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.network.neutron [None req-b30ac97f-4cc6-4723-bd7e-66099a03ea85 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] validate_networks() for [('b6f514de-28c6-4283-b943-c70fcda5540b', None, None, None, None, None)] {{(pid=127285) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:32:08.130527 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d34fa872-af30-4802-b2db-5fa7e1fae3b9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:08.131363 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d34fa872-af30-4802-b2db-5fa7e1fae3b9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:08.146900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d34fa872-af30-4802-b2db-5fa7e1fae3b9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:08.149033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d34fa872-af30-4802-b2db-5fa7e1fae3b9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:08.152104 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d34fa872-af30-4802-b2db-5fa7e1fae3b9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:08.164401 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d34fa872-af30-4802-b2db-5fa7e1fae3b9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:08.168064 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d34fa872-af30-4802-b2db-5fa7e1fae3b9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:08.174735 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d34fa872-af30-4802-b2db-5fa7e1fae3b9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:08.771622 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d34fa872-af30-4802-b2db-5fa7e1fae3b9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:08.800199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d34fa872-af30-4802-b2db-5fa7e1fae3b9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:08.806295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d34fa872-af30-4802-b2db-5fa7e1fae3b9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:08.808342 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d34fa872-af30-4802-b2db-5fa7e1fae3b9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1285 microversion: 2.20 time: 0.685757 Aug 19 16:32:08.813053 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 11/20] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:08 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1285 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:09.491180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-b30ac97f-4cc6-4723-bd7e-66099a03ea85 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Flavor limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:32:09.492717 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-b30ac97f-4cc6-4723-bd7e-66099a03ea85 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Image limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:32:09.493508 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-b30ac97f-4cc6-4723-bd7e-66099a03ea85 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Flavor pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:32:09.494914 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-b30ac97f-4cc6-4723-bd7e-66099a03ea85 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Image pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:32:09.495924 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-b30ac97f-4cc6-4723-bd7e-66099a03ea85 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:32:09.543729 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b30ac97f-4cc6-4723-bd7e-66099a03ea85 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:09.547157 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b30ac97f-4cc6-4723-bd7e-66099a03ea85 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:09.547628 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b30ac97f-4cc6-4723-bd7e-66099a03ea85 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:09.552606 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b30ac97f-4cc6-4723-bd7e-66099a03ea85 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:09.553143 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b30ac97f-4cc6-4723-bd7e-66099a03ea85 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:09.556634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b30ac97f-4cc6-4723-bd7e-66099a03ea85 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:09.616282 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-94137004-21c8-454c-a8bc-c1bb16e7f335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1430450162", "imageRef": "da4af7b7-e205-4511-ad99-3478c2523f74", "flavorRef": "452", "networks": [{"uuid": "afa07345-e9db-49ce-825d-a576b4d92445"}]}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:09.641316 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-b30ac97f-4cc6-4723-bd7e-66099a03ea85 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Getting quotas for project b5638f78ab9440479a209d0023e6d0bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:32:09.657324 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-b30ac97f-4cc6-4723-bd7e-66099a03ea85 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Getting quotas for user 7936bf23a031418b8ce304aa3bbcf8a2 and project b5638f78ab9440479a209d0023e6d0bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:32:09.725490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b30ac97f-4cc6-4723-bd7e-66099a03ea85 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Going to run 1 instances... {{(pid=127285) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:32:09.734692 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.network.neutron [None req-94137004-21c8-454c-a8bc-c1bb16e7f335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] validate_networks() for [('afa07345-e9db-49ce-825d-a576b4d92445', None, None, None, None, None)] {{(pid=127284) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:32:09.735217 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b30ac97f-4cc6-4723-bd7e-66099a03ea85 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='da4af7b7-e205-4511-ad99-3478c2523f74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127285) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:32:09.838673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b30ac97f-4cc6-4723-bd7e-66099a03ea85 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.675999 Aug 19 16:32:09.840213 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 10/21] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Aug 19 16:32:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 2678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 16:32:09.846051 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c3356a3a-c289-4983-a8e9-d1039abea766 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:09.850002 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c3356a3a-c289-4983-a8e9-d1039abea766 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:09.871666 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c3356a3a-c289-4983-a8e9-d1039abea766 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:09.872524 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c3356a3a-c289-4983-a8e9-d1039abea766 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:09.873278 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c3356a3a-c289-4983-a8e9-d1039abea766 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:09.874144 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c3356a3a-c289-4983-a8e9-d1039abea766 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:09.874792 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c3356a3a-c289-4983-a8e9-d1039abea766 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:09.875444 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c3356a3a-c289-4983-a8e9-d1039abea766 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:10.237756 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c3356a3a-c289-4983-a8e9-d1039abea766 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:10.282460 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c3356a3a-c289-4983-a8e9-d1039abea766 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:10.284038 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c3356a3a-c289-4983-a8e9-d1039abea766 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:10.285212 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c3356a3a-c289-4983-a8e9-d1039abea766 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1333 microversion: 2.20 time: 0.443764 Aug 19 16:32:10.295596 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 11/22] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:09 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1333 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:10.312893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f3327c23-c909-49e9-8afc-0265513ef6ba tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:10.313933 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f3327c23-c909-49e9-8afc-0265513ef6ba tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:10.499753 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f3327c23-c909-49e9-8afc-0265513ef6ba tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:10.525574 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f3327c23-c909-49e9-8afc-0265513ef6ba tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1221 microversion: 2.1 time: 0.224217 Aug 19 16:32:10.540801 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 12/23] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:10 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1221 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:11.199085 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-068ef2bd-f9fe-4294-b45a-b68dab192371 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-95561838", "imageRef": "da4af7b7-e205-4511-ad99-3478c2523f74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f05c65e5-ca4c-4b49-b86f-b320d0d9f99a"}], "security_groups": [{"name": "tempest-securitygroup--894349570"}], "key_name": "tempest-keypair-252349643", "user_data": "}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:11.396572 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-94137004-21c8-454c-a8bc-c1bb16e7f335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Flavor limits 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:32:11.398222 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-94137004-21c8-454c-a8bc-c1bb16e7f335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Image limits 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:32:11.398898 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-94137004-21c8-454c-a8bc-c1bb16e7f335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Flavor pref 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:32:11.399612 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-94137004-21c8-454c-a8bc-c1bb16e7f335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Image pref 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:32:11.400420 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-94137004-21c8-454c-a8bc-c1bb16e7f335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:32:11.411175 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-94137004-21c8-454c-a8bc-c1bb16e7f335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:11.412009 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-94137004-21c8-454c-a8bc-c1bb16e7f335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:11.412940 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-94137004-21c8-454c-a8bc-c1bb16e7f335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:11.415068 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-94137004-21c8-454c-a8bc-c1bb16e7f335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:11.415879 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-94137004-21c8-454c-a8bc-c1bb16e7f335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:11.420468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-94137004-21c8-454c-a8bc-c1bb16e7f335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:11.463279 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-94137004-21c8-454c-a8bc-c1bb16e7f335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Getting quotas for project b4516d3cd63d4d89824c4a0b20b6eea1. Resources: {'ram', 'cores', 'instances'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:32:11.470012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-94137004-21c8-454c-a8bc-c1bb16e7f335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Getting quotas for user 8d20b306fc68435baa0da6f09c915157 and project b4516d3cd63d4d89824c4a0b20b6eea1. Resources: {'ram', 'cores', 'instances'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:32:11.490251 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-94137004-21c8-454c-a8bc-c1bb16e7f335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Going to run 1 instances... {{(pid=127284) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:32:11.492702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-94137004-21c8-454c-a8bc-c1bb16e7f335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='da4af7b7-e205-4511-ad99-3478c2523f74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:32:11.560557 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-94137004-21c8-454c-a8bc-c1bb16e7f335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.277323 Aug 19 16:32:11.561898 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 12/24] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Aug 19 16:32:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 16:32:11.567911 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d3f67ea8-b2ed-4a08-9e8a-74f4126f600a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:11.569213 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d3f67ea8-b2ed-4a08-9e8a-74f4126f600a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:11.576683 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d3f67ea8-b2ed-4a08-9e8a-74f4126f600a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:11.577355 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.network.neutron [None req-068ef2bd-f9fe-4294-b45a-b68dab192371 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] validate_networks() for [('f05c65e5-ca4c-4b49-b86f-b320d0d9f99a', None, None, None, None, None)] {{(pid=127285) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:32:11.578679 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d3f67ea8-b2ed-4a08-9e8a-74f4126f600a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:11.579480 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d3f67ea8-b2ed-4a08-9e8a-74f4126f600a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:11.580448 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d3f67ea8-b2ed-4a08-9e8a-74f4126f600a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:11.581493 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d3f67ea8-b2ed-4a08-9e8a-74f4126f600a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:11.582114 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d3f67ea8-b2ed-4a08-9e8a-74f4126f600a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:11.728887 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d3f67ea8-b2ed-4a08-9e8a-74f4126f600a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:11.746235 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d3f67ea8-b2ed-4a08-9e8a-74f4126f600a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:11.747835 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d3f67ea8-b2ed-4a08-9e8a-74f4126f600a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:11.749014 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d3f67ea8-b2ed-4a08-9e8a-74f4126f600a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1333 microversion: 2.20 time: 0.185863 Aug 19 16:32:11.749574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 13/25] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:11 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1333 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:11.770417 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a5142eb7-be79-4a5d-baab-7f770a7b9595 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:11.771044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a5142eb7-be79-4a5d-baab-7f770a7b9595 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:11.789266 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a5142eb7-be79-4a5d-baab-7f770a7b9595 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:11.789766 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a5142eb7-be79-4a5d-baab-7f770a7b9595 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:11.790202 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a5142eb7-be79-4a5d-baab-7f770a7b9595 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:11.790962 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a5142eb7-be79-4a5d-baab-7f770a7b9595 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:11.806501 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a5142eb7-be79-4a5d-baab-7f770a7b9595 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:11.808422 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a5142eb7-be79-4a5d-baab-7f770a7b9595 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:11.928516 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a5142eb7-be79-4a5d-baab-7f770a7b9595 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:11.943350 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a5142eb7-be79-4a5d-baab-7f770a7b9595 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1225 microversion: 2.1 time: 0.186273 Aug 19 16:32:11.958271 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 14/26] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:11 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1225 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:11.963322 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c9a1b270-ec91-429b-ba94-c11a73d39934 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:11.964618 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-c9a1b270-ec91-429b-ba94-c11a73d39934 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:12.093044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c9a1b270-ec91-429b-ba94-c11a73d39934 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:12.130591 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c9a1b270-ec91-429b-ba94-c11a73d39934 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1215 microversion: 2.1 time: 0.151968 Aug 19 16:32:12.138803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 15/27] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:11 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:12.159901 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-eed43b0d-82a5-42bd-9d01-6f40111b922d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1775909130", "imageRef": "da4af7b7-e205-4511-ad99-3478c2523f74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a90442a0-4e78-4b3b-919f-cf6c0969f007"}], "security_groups": [{"name": "tempest-securitygroup--2000156899"}], "key_name": "tempest-keypair-1876633714", "user_data": "}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:12.430721 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.network.neutron [None req-eed43b0d-82a5-42bd-9d01-6f40111b922d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] validate_networks() for [('a90442a0-4e78-4b3b-919f-cf6c0969f007', None, None, None, None, None)] {{(pid=127284) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:32:12.607910 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-068ef2bd-f9fe-4294-b45a-b68dab192371 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Flavor limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:32:12.608895 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-068ef2bd-f9fe-4294-b45a-b68dab192371 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Image limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:32:12.609495 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-068ef2bd-f9fe-4294-b45a-b68dab192371 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Flavor pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:32:12.610171 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-068ef2bd-f9fe-4294-b45a-b68dab192371 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Image pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:32:12.611101 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-068ef2bd-f9fe-4294-b45a-b68dab192371 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:32:12.623022 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-068ef2bd-f9fe-4294-b45a-b68dab192371 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:12.623812 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-068ef2bd-f9fe-4294-b45a-b68dab192371 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:12.624244 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-068ef2bd-f9fe-4294-b45a-b68dab192371 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:12.625135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-068ef2bd-f9fe-4294-b45a-b68dab192371 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:12.625593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-068ef2bd-f9fe-4294-b45a-b68dab192371 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:12.626008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-068ef2bd-f9fe-4294-b45a-b68dab192371 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:12.654407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-068ef2bd-f9fe-4294-b45a-b68dab192371 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Getting quotas for project 1743538991c8415394ac6cd5aed28d6a. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:32:12.659771 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-068ef2bd-f9fe-4294-b45a-b68dab192371 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Getting quotas for user 9b0455ae3ec94c929c940df6a0f6687d and project 1743538991c8415394ac6cd5aed28d6a. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:32:12.673419 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-068ef2bd-f9fe-4294-b45a-b68dab192371 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Going to run 1 instances... {{(pid=127285) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:32:12.676114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-068ef2bd-f9fe-4294-b45a-b68dab192371 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='da4af7b7-e205-4511-ad99-3478c2523f74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127285) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:32:12.792951 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-068ef2bd-f9fe-4294-b45a-b68dab192371 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.596048 Aug 19 16:32:12.794155 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 13/28] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Aug 19 16:32:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 1601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 16:32:12.809779 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8db83d0b-8185-46a4-859e-250ca4d4d23d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:12.810585 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8db83d0b-8185-46a4-859e-250ca4d4d23d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:12.858933 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8db83d0b-8185-46a4-859e-250ca4d4d23d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:12.863627 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8db83d0b-8185-46a4-859e-250ca4d4d23d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:12.866501 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8db83d0b-8185-46a4-859e-250ca4d4d23d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:12.868677 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8db83d0b-8185-46a4-859e-250ca4d4d23d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:12.871289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8db83d0b-8185-46a4-859e-250ca4d4d23d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:12.872015 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8db83d0b-8185-46a4-859e-250ca4d4d23d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:12.950612 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-8db83d0b-8185-46a4-859e-250ca4d4d23d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:12.963101 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-8db83d0b-8185-46a4-859e-250ca4d4d23d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:12.966605 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-8db83d0b-8185-46a4-859e-250ca4d4d23d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:12.968505 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8db83d0b-8185-46a4-859e-250ca4d4d23d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1341 microversion: 2.20 time: 0.171663 Aug 19 16:32:12.969206 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 14/29] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:12 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1341 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:12.974882 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f21c5910-42b2-4585-9a2e-40f9199dc43a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:12.975776 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f21c5910-42b2-4585-9a2e-40f9199dc43a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:13.045243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f21c5910-42b2-4585-9a2e-40f9199dc43a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:13.053644 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f21c5910-42b2-4585-9a2e-40f9199dc43a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1239 microversion: 2.1 time: 0.082934 Aug 19 16:32:13.054214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 15/30] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:12 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1239 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:13.061686 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-91534b29-9ae3-4bcf-8d4a-8b3dd56bc99d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:13.062469 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-91534b29-9ae3-4bcf-8d4a-8b3dd56bc99d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:13.098174 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-91534b29-9ae3-4bcf-8d4a-8b3dd56bc99d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:13.101749 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-91534b29-9ae3-4bcf-8d4a-8b3dd56bc99d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:13.102235 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-91534b29-9ae3-4bcf-8d4a-8b3dd56bc99d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:13.103109 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-91534b29-9ae3-4bcf-8d4a-8b3dd56bc99d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:13.103588 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-91534b29-9ae3-4bcf-8d4a-8b3dd56bc99d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:13.104021 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-91534b29-9ae3-4bcf-8d4a-8b3dd56bc99d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:13.274892 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-91534b29-9ae3-4bcf-8d4a-8b3dd56bc99d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:13.287586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-91534b29-9ae3-4bcf-8d4a-8b3dd56bc99d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1217 microversion: 2.1 time: 0.230086 Aug 19 16:32:13.300136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 16/31] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:13 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1217 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:13.300136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4f9f99a1-cbee-4bd9-b7c2-553a49c81907 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:13.300136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-4f9f99a1-cbee-4bd9-b7c2-553a49c81907 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:13.302903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4f9f99a1-cbee-4bd9-b7c2-553a49c81907 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:13.303390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4f9f99a1-cbee-4bd9-b7c2-553a49c81907 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:13.305254 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4f9f99a1-cbee-4bd9-b7c2-553a49c81907 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:13.305254 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4f9f99a1-cbee-4bd9-b7c2-553a49c81907 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:13.305254 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4f9f99a1-cbee-4bd9-b7c2-553a49c81907 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:13.305485 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4f9f99a1-cbee-4bd9-b7c2-553a49c81907 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:13.346003 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-eed43b0d-82a5-42bd-9d01-6f40111b922d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Flavor limits 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:32:13.346506 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-eed43b0d-82a5-42bd-9d01-6f40111b922d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Image limits 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:32:13.346992 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-eed43b0d-82a5-42bd-9d01-6f40111b922d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Flavor pref 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:32:13.347605 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-eed43b0d-82a5-42bd-9d01-6f40111b922d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Image pref 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:32:13.348299 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-eed43b0d-82a5-42bd-9d01-6f40111b922d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:32:13.387251 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-eed43b0d-82a5-42bd-9d01-6f40111b922d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:13.387740 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-eed43b0d-82a5-42bd-9d01-6f40111b922d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:13.388175 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-eed43b0d-82a5-42bd-9d01-6f40111b922d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:13.388931 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-eed43b0d-82a5-42bd-9d01-6f40111b922d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:13.389391 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-eed43b0d-82a5-42bd-9d01-6f40111b922d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:13.389822 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-eed43b0d-82a5-42bd-9d01-6f40111b922d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:13.407248 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-4f9f99a1-cbee-4bd9-b7c2-553a49c81907 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:13.415112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4f9f99a1-cbee-4bd9-b7c2-553a49c81907 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1219 microversion: 2.1 time: 0.125728 Aug 19 16:32:13.415742 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 17/32] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:13 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1219 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:13.445894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-eed43b0d-82a5-42bd-9d01-6f40111b922d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Getting quotas for project e15ca27a2c874997bd01de973a948311. Resources: {'ram', 'cores', 'instances'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:32:13.450821 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-eed43b0d-82a5-42bd-9d01-6f40111b922d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Getting quotas for user d55dc52ab80642da90f05e74092ffdf8 and project e15ca27a2c874997bd01de973a948311. Resources: {'ram', 'cores', 'instances'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:32:13.472210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-eed43b0d-82a5-42bd-9d01-6f40111b922d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Going to run 1 instances... {{(pid=127284) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:32:13.474633 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-eed43b0d-82a5-42bd-9d01-6f40111b922d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='da4af7b7-e205-4511-ad99-3478c2523f74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:32:13.556221 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-eed43b0d-82a5-42bd-9d01-6f40111b922d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.415604 Aug 19 16:32:13.562749 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 16/33] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Aug 19 16:32:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 16:32:13.572569 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-59d52e92-1609-4c35-9f33-2ba701114126 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:13.573845 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-59d52e92-1609-4c35-9f33-2ba701114126 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:13.700875 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-59d52e92-1609-4c35-9f33-2ba701114126 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:13.708948 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-59d52e92-1609-4c35-9f33-2ba701114126 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1238 microversion: 2.1 time: 0.144540 Aug 19 16:32:13.709527 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 18/34] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:13 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1238 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:14.000586 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d24eeb32-92d5-4cff-ba42-8e19b4433474 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:14.001707 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d24eeb32-92d5-4cff-ba42-8e19b4433474 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:14.015100 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d24eeb32-92d5-4cff-ba42-8e19b4433474 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:14.015765 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d24eeb32-92d5-4cff-ba42-8e19b4433474 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:14.016614 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d24eeb32-92d5-4cff-ba42-8e19b4433474 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:14.018284 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d24eeb32-92d5-4cff-ba42-8e19b4433474 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:14.018920 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d24eeb32-92d5-4cff-ba42-8e19b4433474 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:14.019621 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d24eeb32-92d5-4cff-ba42-8e19b4433474 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:14.077407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ad328da3-7b5f-4516-bd76-fad12709eeeb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:14.078292 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ad328da3-7b5f-4516-bd76-fad12709eeeb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:14.090190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad328da3-7b5f-4516-bd76-fad12709eeeb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:14.090892 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad328da3-7b5f-4516-bd76-fad12709eeeb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:14.091528 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad328da3-7b5f-4516-bd76-fad12709eeeb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:14.092513 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad328da3-7b5f-4516-bd76-fad12709eeeb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:14.093184 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad328da3-7b5f-4516-bd76-fad12709eeeb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:14.093825 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad328da3-7b5f-4516-bd76-fad12709eeeb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:14.117548 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d24eeb32-92d5-4cff-ba42-8e19b4433474 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:14.131297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d24eeb32-92d5-4cff-ba42-8e19b4433474 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:14.133476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d24eeb32-92d5-4cff-ba42-8e19b4433474 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:14.134802 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d24eeb32-92d5-4cff-ba42-8e19b4433474 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1341 microversion: 2.20 time: 0.139922 Aug 19 16:32:14.137214 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 17/35] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:13 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1341 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:14.261856 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ad328da3-7b5f-4516-bd76-fad12709eeeb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:14.273068 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ad328da3-7b5f-4516-bd76-fad12709eeeb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1243 microversion: 2.1 time: 0.201865 Aug 19 16:32:14.274320 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 19/36] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:14 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1243 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:14.314191 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7e2ff86d-0488-4c73-a25f-9be59fbc52c9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:14.315121 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7e2ff86d-0488-4c73-a25f-9be59fbc52c9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:14.338390 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7e2ff86d-0488-4c73-a25f-9be59fbc52c9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:14.341637 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7e2ff86d-0488-4c73-a25f-9be59fbc52c9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:14.343132 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7e2ff86d-0488-4c73-a25f-9be59fbc52c9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:14.344376 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7e2ff86d-0488-4c73-a25f-9be59fbc52c9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:14.345885 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7e2ff86d-0488-4c73-a25f-9be59fbc52c9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:14.355721 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7e2ff86d-0488-4c73-a25f-9be59fbc52c9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:14.455534 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d6530c01-fbb5-4590-b795-0786ca765aae tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:14.456159 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d6530c01-fbb5-4590-b795-0786ca765aae tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:14.482673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d6530c01-fbb5-4590-b795-0786ca765aae tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:14.483171 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d6530c01-fbb5-4590-b795-0786ca765aae tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:14.483607 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d6530c01-fbb5-4590-b795-0786ca765aae tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:14.484305 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d6530c01-fbb5-4590-b795-0786ca765aae tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:14.484766 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d6530c01-fbb5-4590-b795-0786ca765aae tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:14.488959 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d6530c01-fbb5-4590-b795-0786ca765aae tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:14.543352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7e2ff86d-0488-4c73-a25f-9be59fbc52c9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:14.552733 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7e2ff86d-0488-4c73-a25f-9be59fbc52c9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1217 microversion: 2.1 time: 0.242439 Aug 19 16:32:14.553523 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 18/37] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:14 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1217 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:14.603616 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d6530c01-fbb5-4590-b795-0786ca765aae tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:14.612805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d6530c01-fbb5-4590-b795-0786ca765aae tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1219 microversion: 2.1 time: 0.171734 Aug 19 16:32:14.613558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 20/38] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:14 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1219 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:14.732060 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-676f4a1b-f0a9-4a6f-852a-949196e3b7db tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:14.732935 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-676f4a1b-f0a9-4a6f-852a-949196e3b7db tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:14.742223 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:14.764366 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-676f4a1b-f0a9-4a6f-852a-949196e3b7db tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:14.764922 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-676f4a1b-f0a9-4a6f-852a-949196e3b7db tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:14.765369 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-676f4a1b-f0a9-4a6f-852a-949196e3b7db tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:14.766081 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-676f4a1b-f0a9-4a6f-852a-949196e3b7db tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:14.766692 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-676f4a1b-f0a9-4a6f-852a-949196e3b7db tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:14.767267 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-676f4a1b-f0a9-4a6f-852a-949196e3b7db tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:14.871948 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-676f4a1b-f0a9-4a6f-852a-949196e3b7db tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:14.883711 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-676f4a1b-f0a9-4a6f-852a-949196e3b7db tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1242 microversion: 2.1 time: 0.155619 Aug 19 16:32:14.899601 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 19/39] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:14 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1242 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:15.159781 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ce19a2bd-c346-42d8-a563-559d24b94091 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:15.162261 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ce19a2bd-c346-42d8-a563-559d24b94091 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:15.169305 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce19a2bd-c346-42d8-a563-559d24b94091 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:15.169984 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce19a2bd-c346-42d8-a563-559d24b94091 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:15.171633 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce19a2bd-c346-42d8-a563-559d24b94091 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:15.172539 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce19a2bd-c346-42d8-a563-559d24b94091 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:15.173304 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce19a2bd-c346-42d8-a563-559d24b94091 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:15.174194 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce19a2bd-c346-42d8-a563-559d24b94091 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:15.302398 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ce19a2bd-c346-42d8-a563-559d24b94091 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:15.307202 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-fc94f62f-0f1d-4e3e-95c3-da21df4bc8c8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:15.311160 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-fc94f62f-0f1d-4e3e-95c3-da21df4bc8c8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:15.332706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ce19a2bd-c346-42d8-a563-559d24b94091 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:15.335068 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fc94f62f-0f1d-4e3e-95c3-da21df4bc8c8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:15.336019 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fc94f62f-0f1d-4e3e-95c3-da21df4bc8c8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:15.337967 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ce19a2bd-c346-42d8-a563-559d24b94091 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:15.338547 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fc94f62f-0f1d-4e3e-95c3-da21df4bc8c8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:15.341046 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fc94f62f-0f1d-4e3e-95c3-da21df4bc8c8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:15.341972 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fc94f62f-0f1d-4e3e-95c3-da21df4bc8c8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:15.342502 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ce19a2bd-c346-42d8-a563-559d24b94091 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1351 microversion: 2.20 time: 0.184646 Aug 19 16:32:15.357399 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fc94f62f-0f1d-4e3e-95c3-da21df4bc8c8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:15.357631 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 21/40] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:15 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1351 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:15.442094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-fc94f62f-0f1d-4e3e-95c3-da21df4bc8c8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:15.452677 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-fc94f62f-0f1d-4e3e-95c3-da21df4bc8c8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1243 microversion: 2.1 time: 0.159783 Aug 19 16:32:15.453812 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 20/41] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:15 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1243 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:15.574693 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6ea81dca-4987-4138-9588-f540ca108be3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:15.575360 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6ea81dca-4987-4138-9588-f540ca108be3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:15.597715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6ea81dca-4987-4138-9588-f540ca108be3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:15.599255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6ea81dca-4987-4138-9588-f540ca108be3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:15.600113 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6ea81dca-4987-4138-9588-f540ca108be3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:15.600600 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6ea81dca-4987-4138-9588-f540ca108be3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:15.601051 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6ea81dca-4987-4138-9588-f540ca108be3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:15.602043 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6ea81dca-4987-4138-9588-f540ca108be3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:15.639633 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-34d980b8-31eb-4f78-94c3-042631d581b7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:15.641017 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-34d980b8-31eb-4f78-94c3-042631d581b7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:15.658905 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-34d980b8-31eb-4f78-94c3-042631d581b7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:15.660625 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-34d980b8-31eb-4f78-94c3-042631d581b7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:15.664439 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-34d980b8-31eb-4f78-94c3-042631d581b7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:15.672015 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-34d980b8-31eb-4f78-94c3-042631d581b7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:15.672705 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-34d980b8-31eb-4f78-94c3-042631d581b7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:15.675798 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-34d980b8-31eb-4f78-94c3-042631d581b7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:15.754910 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6ea81dca-4987-4138-9588-f540ca108be3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:15.767429 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6ea81dca-4987-4138-9588-f540ca108be3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1217 microversion: 2.1 time: 0.196284 Aug 19 16:32:15.768783 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 22/42] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:15 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1217 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:15.835029 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-34d980b8-31eb-4f78-94c3-042631d581b7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:15.855511 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-34d980b8-31eb-4f78-94c3-042631d581b7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1211 microversion: 2.1 time: 0.218118 Aug 19 16:32:15.856139 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 21/43] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:15 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1211 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:15.908063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0e1ab58a-9b9e-4f5f-8f1d-daa2ced99cc5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:15.909164 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-0e1ab58a-9b9e-4f5f-8f1d-daa2ced99cc5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:15.921687 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0e1ab58a-9b9e-4f5f-8f1d-daa2ced99cc5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:15.923026 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0e1ab58a-9b9e-4f5f-8f1d-daa2ced99cc5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:15.925105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0e1ab58a-9b9e-4f5f-8f1d-daa2ced99cc5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:15.926814 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0e1ab58a-9b9e-4f5f-8f1d-daa2ced99cc5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:15.929884 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0e1ab58a-9b9e-4f5f-8f1d-daa2ced99cc5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:15.931337 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0e1ab58a-9b9e-4f5f-8f1d-daa2ced99cc5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:16.080544 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-0e1ab58a-9b9e-4f5f-8f1d-daa2ced99cc5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:16.091484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-0e1ab58a-9b9e-4f5f-8f1d-daa2ced99cc5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1234 microversion: 2.1 time: 0.188404 Aug 19 16:32:16.097329 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 23/44] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:15 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1234 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:16.371875 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8ded9703-6337-435c-b0cb-1da703b3d11d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:16.372510 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8ded9703-6337-435c-b0cb-1da703b3d11d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:16.380382 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8ded9703-6337-435c-b0cb-1da703b3d11d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:16.381334 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8ded9703-6337-435c-b0cb-1da703b3d11d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:16.381941 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8ded9703-6337-435c-b0cb-1da703b3d11d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:16.382979 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8ded9703-6337-435c-b0cb-1da703b3d11d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:16.383669 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8ded9703-6337-435c-b0cb-1da703b3d11d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:16.384244 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8ded9703-6337-435c-b0cb-1da703b3d11d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:16.476918 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b0ba9a27-892c-47a4-ac43-9ea12d3ab8ff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:16.477892 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b0ba9a27-892c-47a4-ac43-9ea12d3ab8ff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:16.509176 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b0ba9a27-892c-47a4-ac43-9ea12d3ab8ff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:16.509776 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b0ba9a27-892c-47a4-ac43-9ea12d3ab8ff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:16.510225 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b0ba9a27-892c-47a4-ac43-9ea12d3ab8ff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:16.511880 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b0ba9a27-892c-47a4-ac43-9ea12d3ab8ff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:16.512311 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8ded9703-6337-435c-b0cb-1da703b3d11d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:16.512960 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b0ba9a27-892c-47a4-ac43-9ea12d3ab8ff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:16.513401 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b0ba9a27-892c-47a4-ac43-9ea12d3ab8ff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:16.538906 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8ded9703-6337-435c-b0cb-1da703b3d11d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:16.542269 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8ded9703-6337-435c-b0cb-1da703b3d11d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:16.546178 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8ded9703-6337-435c-b0cb-1da703b3d11d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1339 microversion: 2.20 time: 0.178650 Aug 19 16:32:16.551012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 22/45] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:16 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1339 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:16.647393 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b0ba9a27-892c-47a4-ac43-9ea12d3ab8ff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:16.663089 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b0ba9a27-892c-47a4-ac43-9ea12d3ab8ff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1291 microversion: 2.1 time: 0.192914 Aug 19 16:32:16.669191 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 24/46] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:16 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1291 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:16.791363 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-67a36f6e-14eb-4f04-9f57-0356f81127b1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:16.792888 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-67a36f6e-14eb-4f04-9f57-0356f81127b1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:16.800933 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-67a36f6e-14eb-4f04-9f57-0356f81127b1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:16.804341 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-67a36f6e-14eb-4f04-9f57-0356f81127b1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:16.805855 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-67a36f6e-14eb-4f04-9f57-0356f81127b1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:16.814661 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-67a36f6e-14eb-4f04-9f57-0356f81127b1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:16.815157 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-67a36f6e-14eb-4f04-9f57-0356f81127b1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:16.815594 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-67a36f6e-14eb-4f04-9f57-0356f81127b1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:16.878212 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e4b66909-3f9a-4ca8-83dc-1a57f9a6c7d2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:16.879149 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e4b66909-3f9a-4ca8-83dc-1a57f9a6c7d2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:16.886856 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:16.912353 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e4b66909-3f9a-4ca8-83dc-1a57f9a6c7d2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:16.915890 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e4b66909-3f9a-4ca8-83dc-1a57f9a6c7d2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:16.916532 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e4b66909-3f9a-4ca8-83dc-1a57f9a6c7d2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:16.918375 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e4b66909-3f9a-4ca8-83dc-1a57f9a6c7d2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:16.920524 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e4b66909-3f9a-4ca8-83dc-1a57f9a6c7d2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:16.922455 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e4b66909-3f9a-4ca8-83dc-1a57f9a6c7d2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:17.062029 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e4b66909-3f9a-4ca8-83dc-1a57f9a6c7d2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:17.080246 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e4b66909-3f9a-4ca8-83dc-1a57f9a6c7d2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1285 microversion: 2.1 time: 0.206581 Aug 19 16:32:17.085933 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 25/47] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:16 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1285 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:17.119787 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2f8dd6ad-1691-4b8f-b2a4-a46a18c28329 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:17.121840 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2f8dd6ad-1691-4b8f-b2a4-a46a18c28329 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:17.133226 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2f8dd6ad-1691-4b8f-b2a4-a46a18c28329 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:17.134491 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2f8dd6ad-1691-4b8f-b2a4-a46a18c28329 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:17.137342 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2f8dd6ad-1691-4b8f-b2a4-a46a18c28329 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:17.139344 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2f8dd6ad-1691-4b8f-b2a4-a46a18c28329 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:17.140589 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2f8dd6ad-1691-4b8f-b2a4-a46a18c28329 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:17.141892 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2f8dd6ad-1691-4b8f-b2a4-a46a18c28329 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:17.218112 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-67a36f6e-14eb-4f04-9f57-0356f81127b1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:17.235586 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-67a36f6e-14eb-4f04-9f57-0356f81127b1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1273 microversion: 2.1 time: 0.447927 Aug 19 16:32:17.245741 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 23/48] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:16 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1273 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:17.549230 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2f8dd6ad-1691-4b8f-b2a4-a46a18c28329 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:17.570610 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1ceb9ccb-6310-4e4a-ac9f-ce8bbc2eed6c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:17.571263 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1ceb9ccb-6310-4e4a-ac9f-ce8bbc2eed6c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:17.574324 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2f8dd6ad-1691-4b8f-b2a4-a46a18c28329 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1290 microversion: 2.1 time: 0.457561 Aug 19 16:32:17.588652 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 26/49] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:17 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1290 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:17.596744 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1ceb9ccb-6310-4e4a-ac9f-ce8bbc2eed6c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:17.597328 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1ceb9ccb-6310-4e4a-ac9f-ce8bbc2eed6c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:17.597780 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1ceb9ccb-6310-4e4a-ac9f-ce8bbc2eed6c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:17.603704 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1ceb9ccb-6310-4e4a-ac9f-ce8bbc2eed6c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:17.604252 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1ceb9ccb-6310-4e4a-ac9f-ce8bbc2eed6c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:17.604826 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1ceb9ccb-6310-4e4a-ac9f-ce8bbc2eed6c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:17.693423 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6adff15d-a019-4b28-a9ec-a6df312185bd tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:17.694060 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6adff15d-a019-4b28-a9ec-a6df312185bd tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:17.709737 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6adff15d-a019-4b28-a9ec-a6df312185bd tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:17.710236 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6adff15d-a019-4b28-a9ec-a6df312185bd tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:17.714830 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6adff15d-a019-4b28-a9ec-a6df312185bd tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:17.716342 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6adff15d-a019-4b28-a9ec-a6df312185bd tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:17.719060 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6adff15d-a019-4b28-a9ec-a6df312185bd tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:17.721813 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6adff15d-a019-4b28-a9ec-a6df312185bd tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:17.837450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6adff15d-a019-4b28-a9ec-a6df312185bd tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:17.849841 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6adff15d-a019-4b28-a9ec-a6df312185bd tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1299 microversion: 2.1 time: 0.162170 Aug 19 16:32:17.871804 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 27/50] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:17 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1299 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:18.014995 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1ceb9ccb-6310-4e4a-ac9f-ce8bbc2eed6c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:18.028727 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1ceb9ccb-6310-4e4a-ac9f-ce8bbc2eed6c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:18.031150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1ceb9ccb-6310-4e4a-ac9f-ce8bbc2eed6c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:18.032714 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1ceb9ccb-6310-4e4a-ac9f-ce8bbc2eed6c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1407 microversion: 2.20 time: 0.466200 Aug 19 16:32:18.033890 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 24/51] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:17 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1407 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:18.110516 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0d97b53a-225e-4488-b28c-788ffc2c5baa tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:18.111134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-0d97b53a-225e-4488-b28c-788ffc2c5baa tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:18.117757 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0d97b53a-225e-4488-b28c-788ffc2c5baa tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:18.126475 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0d97b53a-225e-4488-b28c-788ffc2c5baa tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:18.127184 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0d97b53a-225e-4488-b28c-788ffc2c5baa tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:18.129833 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0d97b53a-225e-4488-b28c-788ffc2c5baa tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:18.132281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0d97b53a-225e-4488-b28c-788ffc2c5baa tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:18.137461 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0d97b53a-225e-4488-b28c-788ffc2c5baa tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:18.261394 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-9c0d98c9-3277-4974-b787-3d303597e93d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:18.262329 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-9c0d98c9-3277-4974-b787-3d303597e93d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:18.277567 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9c0d98c9-3277-4974-b787-3d303597e93d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:18.277567 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9c0d98c9-3277-4974-b787-3d303597e93d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:18.277729 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9c0d98c9-3277-4974-b787-3d303597e93d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:18.278341 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9c0d98c9-3277-4974-b787-3d303597e93d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:18.278795 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9c0d98c9-3277-4974-b787-3d303597e93d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:18.279224 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9c0d98c9-3277-4974-b787-3d303597e93d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:18.291189 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-0d97b53a-225e-4488-b28c-788ffc2c5baa tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:18.305222 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-0d97b53a-225e-4488-b28c-788ffc2c5baa tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1273 microversion: 2.1 time: 0.198327 Aug 19 16:32:18.306431 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 28/52] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:18 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:18.411399 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-9c0d98c9-3277-4974-b787-3d303597e93d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:18.420264 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-9c0d98c9-3277-4974-b787-3d303597e93d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1281 microversion: 2.1 time: 0.163274 Aug 19 16:32:18.421192 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 25/53] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:18 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1281 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:18.595734 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3a402042-57a4-422c-9bdb-7d9ae324870c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:18.596352 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-3a402042-57a4-422c-9bdb-7d9ae324870c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:18.602919 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3a402042-57a4-422c-9bdb-7d9ae324870c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:18.603585 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3a402042-57a4-422c-9bdb-7d9ae324870c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:18.604125 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3a402042-57a4-422c-9bdb-7d9ae324870c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:18.604931 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3a402042-57a4-422c-9bdb-7d9ae324870c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:18.605408 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3a402042-57a4-422c-9bdb-7d9ae324870c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:18.605867 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3a402042-57a4-422c-9bdb-7d9ae324870c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:18.740649 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-3a402042-57a4-422c-9bdb-7d9ae324870c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:18.752142 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3a402042-57a4-422c-9bdb-7d9ae324870c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1290 microversion: 2.1 time: 0.160184 Aug 19 16:32:18.757921 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 29/54] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:18 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1290 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:18.881635 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-56c7aaad-5036-438f-b80b-2bdeca410569 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:18.882546 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-56c7aaad-5036-438f-b80b-2bdeca410569 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:18.889333 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-56c7aaad-5036-438f-b80b-2bdeca410569 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:18.889771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-56c7aaad-5036-438f-b80b-2bdeca410569 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:18.890317 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-56c7aaad-5036-438f-b80b-2bdeca410569 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:18.891005 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-56c7aaad-5036-438f-b80b-2bdeca410569 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:18.893859 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-56c7aaad-5036-438f-b80b-2bdeca410569 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:18.896248 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-56c7aaad-5036-438f-b80b-2bdeca410569 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:19.006520 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-56c7aaad-5036-438f-b80b-2bdeca410569 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:19.017996 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-56c7aaad-5036-438f-b80b-2bdeca410569 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1299 microversion: 2.1 time: 0.140316 Aug 19 16:32:19.030086 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 26/55] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:18 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1299 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:19.059053 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-934be4ea-5e73-4333-b2b3-88a3b28b631b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:19.059963 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-934be4ea-5e73-4333-b2b3-88a3b28b631b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:19.066490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-934be4ea-5e73-4333-b2b3-88a3b28b631b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:19.067217 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-934be4ea-5e73-4333-b2b3-88a3b28b631b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:19.067891 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-934be4ea-5e73-4333-b2b3-88a3b28b631b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:19.068668 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-934be4ea-5e73-4333-b2b3-88a3b28b631b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:19.069368 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-934be4ea-5e73-4333-b2b3-88a3b28b631b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:19.070005 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-934be4ea-5e73-4333-b2b3-88a3b28b631b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:19.090867 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=100 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:19.315350 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-934be4ea-5e73-4333-b2b3-88a3b28b631b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:19.326329 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-934be4ea-5e73-4333-b2b3-88a3b28b631b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:19.328135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-934be4ea-5e73-4333-b2b3-88a3b28b631b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:19.329567 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-934be4ea-5e73-4333-b2b3-88a3b28b631b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1407 microversion: 2.20 time: 0.274873 Aug 19 16:32:19.333425 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a6171051-aa26-4d54-98ba-f7cc08d78e5a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:19.334276 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a6171051-aa26-4d54-98ba-f7cc08d78e5a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:19.339990 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 30/56] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:19 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:19.351927 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a6171051-aa26-4d54-98ba-f7cc08d78e5a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:19.353375 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a6171051-aa26-4d54-98ba-f7cc08d78e5a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:19.355768 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a6171051-aa26-4d54-98ba-f7cc08d78e5a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:19.357817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a6171051-aa26-4d54-98ba-f7cc08d78e5a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:19.358491 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a6171051-aa26-4d54-98ba-f7cc08d78e5a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:19.360316 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a6171051-aa26-4d54-98ba-f7cc08d78e5a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:19.443459 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-5f0e83cf-8360-410d-b7cd-a0d50b6bde68 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:19.444262 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-5f0e83cf-8360-410d-b7cd-a0d50b6bde68 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:19.456653 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5f0e83cf-8360-410d-b7cd-a0d50b6bde68 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:19.457186 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5f0e83cf-8360-410d-b7cd-a0d50b6bde68 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:19.457627 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5f0e83cf-8360-410d-b7cd-a0d50b6bde68 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:19.458341 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5f0e83cf-8360-410d-b7cd-a0d50b6bde68 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:19.458805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5f0e83cf-8360-410d-b7cd-a0d50b6bde68 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:19.459232 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5f0e83cf-8360-410d-b7cd-a0d50b6bde68 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:19.488428 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a6171051-aa26-4d54-98ba-f7cc08d78e5a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:19.510041 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a6171051-aa26-4d54-98ba-f7cc08d78e5a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1273 microversion: 2.1 time: 0.185482 Aug 19 16:32:19.512265 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 27/57] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:19 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1273 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:19.615501 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5f0e83cf-8360-410d-b7cd-a0d50b6bde68 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:19.624137 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-5f0e83cf-8360-410d-b7cd-a0d50b6bde68 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1281 microversion: 2.1 time: 0.185196 Aug 19 16:32:19.624746 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 31/58] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:19 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1281 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:19.774556 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1a0644fe-f487-4cba-9884-58e4d18878c1 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:19.775173 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1a0644fe-f487-4cba-9884-58e4d18878c1 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:19.789711 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1a0644fe-f487-4cba-9884-58e4d18878c1 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:19.790490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1a0644fe-f487-4cba-9884-58e4d18878c1 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:19.791101 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1a0644fe-f487-4cba-9884-58e4d18878c1 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:19.794241 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1a0644fe-f487-4cba-9884-58e4d18878c1 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:19.794963 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1a0644fe-f487-4cba-9884-58e4d18878c1 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:19.795584 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1a0644fe-f487-4cba-9884-58e4d18878c1 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:19.891028 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1a0644fe-f487-4cba-9884-58e4d18878c1 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:19.899151 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1a0644fe-f487-4cba-9884-58e4d18878c1 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1290 microversion: 2.1 time: 0.128319 Aug 19 16:32:19.899729 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 28/59] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:19 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1290 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:20.039539 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-fec6f25f-9da0-4aa9-9a24-7290b4125641 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:20.040823 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-fec6f25f-9da0-4aa9-9a24-7290b4125641 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:20.047659 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fec6f25f-9da0-4aa9-9a24-7290b4125641 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:20.048353 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fec6f25f-9da0-4aa9-9a24-7290b4125641 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:20.048798 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fec6f25f-9da0-4aa9-9a24-7290b4125641 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:20.049899 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fec6f25f-9da0-4aa9-9a24-7290b4125641 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:20.050353 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fec6f25f-9da0-4aa9-9a24-7290b4125641 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:20.050772 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fec6f25f-9da0-4aa9-9a24-7290b4125641 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:20.170672 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fec6f25f-9da0-4aa9-9a24-7290b4125641 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:20.179162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-fec6f25f-9da0-4aa9-9a24-7290b4125641 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1299 microversion: 2.1 time: 0.143758 Aug 19 16:32:20.179977 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 32/60] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:20 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1299 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:20.353756 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8b7c857a-8c21-421c-8877-5fac74735a1f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:20.356733 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8b7c857a-8c21-421c-8877-5fac74735a1f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:20.366396 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b7c857a-8c21-421c-8877-5fac74735a1f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:20.371837 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b7c857a-8c21-421c-8877-5fac74735a1f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:20.375028 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b7c857a-8c21-421c-8877-5fac74735a1f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:20.377074 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b7c857a-8c21-421c-8877-5fac74735a1f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:20.377762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b7c857a-8c21-421c-8877-5fac74735a1f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:20.379955 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b7c857a-8c21-421c-8877-5fac74735a1f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:20.423029 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=100 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:20.532959 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1259095d-d7c4-4e4d-a360-80092fd5e44d tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:20.533786 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-1259095d-d7c4-4e4d-a360-80092fd5e44d tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:20.541393 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1259095d-d7c4-4e4d-a360-80092fd5e44d tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:20.547862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1259095d-d7c4-4e4d-a360-80092fd5e44d tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:20.548706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1259095d-d7c4-4e4d-a360-80092fd5e44d tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:20.550437 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1259095d-d7c4-4e4d-a360-80092fd5e44d tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:20.552186 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1259095d-d7c4-4e4d-a360-80092fd5e44d tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:20.552993 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1259095d-d7c4-4e4d-a360-80092fd5e44d tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:20.643595 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8b7c857a-8c21-421c-8877-5fac74735a1f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:20.661066 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8b7c857a-8c21-421c-8877-5fac74735a1f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:20.662668 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8b7c857a-8c21-421c-8877-5fac74735a1f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:20.668425 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8b7c857a-8c21-421c-8877-5fac74735a1f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1407 microversion: 2.20 time: 0.318582 Aug 19 16:32:20.671432 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 29/61] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:20 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1407 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:20.676669 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-3d71192b-8f77-4190-ac23-298f31eb6061 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:20.677715 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-3d71192b-8f77-4190-ac23-298f31eb6061 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:20.685727 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3d71192b-8f77-4190-ac23-298f31eb6061 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:20.686751 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3d71192b-8f77-4190-ac23-298f31eb6061 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:20.687575 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3d71192b-8f77-4190-ac23-298f31eb6061 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:20.691528 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3d71192b-8f77-4190-ac23-298f31eb6061 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:20.692360 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3d71192b-8f77-4190-ac23-298f31eb6061 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:20.693791 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3d71192b-8f77-4190-ac23-298f31eb6061 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:20.744245 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1259095d-d7c4-4e4d-a360-80092fd5e44d tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:20.764115 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-1259095d-d7c4-4e4d-a360-80092fd5e44d tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1273 microversion: 2.1 time: 0.235133 Aug 19 16:32:20.767151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 33/62] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:20 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1273 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:20.890808 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-3d71192b-8f77-4190-ac23-298f31eb6061 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:20.907946 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-3d71192b-8f77-4190-ac23-298f31eb6061 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1281 microversion: 2.1 time: 0.234959 Aug 19 16:32:20.911147 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 30/63] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:20 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1281 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:20.922317 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-7f823dbc-613c-4f25-a049-a38abccb8ce1 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:20.923419 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-7f823dbc-613c-4f25-a049-a38abccb8ce1 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:20.941281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f823dbc-613c-4f25-a049-a38abccb8ce1 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:20.944708 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f823dbc-613c-4f25-a049-a38abccb8ce1 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:20.945395 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f823dbc-613c-4f25-a049-a38abccb8ce1 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:20.948932 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f823dbc-613c-4f25-a049-a38abccb8ce1 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:20.950170 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f823dbc-613c-4f25-a049-a38abccb8ce1 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:20.951285 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f823dbc-613c-4f25-a049-a38abccb8ce1 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:21.043826 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7f823dbc-613c-4f25-a049-a38abccb8ce1 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:21.060608 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-7f823dbc-613c-4f25-a049-a38abccb8ce1 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1290 microversion: 2.1 time: 0.144771 Aug 19 16:32:21.061222 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 34/64] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:20 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1290 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:21.202870 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f8310e75-6dfc-4c68-a789-846da4f856db tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:21.203998 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f8310e75-6dfc-4c68-a789-846da4f856db tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:21.217603 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f8310e75-6dfc-4c68-a789-846da4f856db tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:21.218295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f8310e75-6dfc-4c68-a789-846da4f856db tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:21.218981 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f8310e75-6dfc-4c68-a789-846da4f856db tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:21.220001 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f8310e75-6dfc-4c68-a789-846da4f856db tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:21.220833 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f8310e75-6dfc-4c68-a789-846da4f856db tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:21.221443 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f8310e75-6dfc-4c68-a789-846da4f856db tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:21.334453 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f8310e75-6dfc-4c68-a789-846da4f856db tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:21.346561 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f8310e75-6dfc-4c68-a789-846da4f856db tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1299 microversion: 2.1 time: 0.147981 Aug 19 16:32:21.352635 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 31/65] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:21 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1299 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:21.695633 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6dd42ac4-6c17-4034-8561-7d0f0482c320 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:21.696231 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6dd42ac4-6c17-4034-8561-7d0f0482c320 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:21.712040 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6dd42ac4-6c17-4034-8561-7d0f0482c320 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:21.712530 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6dd42ac4-6c17-4034-8561-7d0f0482c320 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:21.712988 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6dd42ac4-6c17-4034-8561-7d0f0482c320 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:21.714533 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6dd42ac4-6c17-4034-8561-7d0f0482c320 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:21.715128 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6dd42ac4-6c17-4034-8561-7d0f0482c320 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:21.715692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6dd42ac4-6c17-4034-8561-7d0f0482c320 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:21.787664 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b1c26197-fd48-4c67-95ff-7fce1789f499 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:21.789079 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-b1c26197-fd48-4c67-95ff-7fce1789f499 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:21.809611 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b1c26197-fd48-4c67-95ff-7fce1789f499 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:21.810263 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b1c26197-fd48-4c67-95ff-7fce1789f499 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:21.810849 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b1c26197-fd48-4c67-95ff-7fce1789f499 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:21.811693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b1c26197-fd48-4c67-95ff-7fce1789f499 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:21.812454 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b1c26197-fd48-4c67-95ff-7fce1789f499 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:21.813043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b1c26197-fd48-4c67-95ff-7fce1789f499 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:21.918282 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b1c26197-fd48-4c67-95ff-7fce1789f499 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:21.930752 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b1c26197-fd48-4c67-95ff-7fce1789f499 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1273 microversion: 2.1 time: 0.144273 Aug 19 16:32:21.933995 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 32/66] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:21 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:21.950163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8243746b-eaef-479d-a11d-33c643f517f2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:21.951143 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8243746b-eaef-479d-a11d-33c643f517f2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:21.961088 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8243746b-eaef-479d-a11d-33c643f517f2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:21.961751 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8243746b-eaef-479d-a11d-33c643f517f2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:21.965648 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8243746b-eaef-479d-a11d-33c643f517f2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:21.966587 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8243746b-eaef-479d-a11d-33c643f517f2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:21.967193 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8243746b-eaef-479d-a11d-33c643f517f2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:21.967760 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8243746b-eaef-479d-a11d-33c643f517f2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:22.060147 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8243746b-eaef-479d-a11d-33c643f517f2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:22.068388 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8243746b-eaef-479d-a11d-33c643f517f2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1281 microversion: 2.1 time: 0.133136 Aug 19 16:32:22.083706 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 33/67] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:21 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1281 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:22.089449 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d112690f-183e-408a-8f51-baf648e9ee46 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:22.090323 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d112690f-183e-408a-8f51-baf648e9ee46 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:22.096798 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d112690f-183e-408a-8f51-baf648e9ee46 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:22.097593 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d112690f-183e-408a-8f51-baf648e9ee46 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:22.098168 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d112690f-183e-408a-8f51-baf648e9ee46 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:22.099534 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d112690f-183e-408a-8f51-baf648e9ee46 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:22.100126 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d112690f-183e-408a-8f51-baf648e9ee46 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:22.100945 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d112690f-183e-408a-8f51-baf648e9ee46 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:22.172055 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d112690f-183e-408a-8f51-baf648e9ee46 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:22.180357 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d112690f-183e-408a-8f51-baf648e9ee46 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1290 microversion: 2.1 time: 0.095279 Aug 19 16:32:22.183018 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 34/68] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:22 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1290 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:22.185304 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6dd42ac4-6c17-4034-8561-7d0f0482c320 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:22.198602 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6dd42ac4-6c17-4034-8561-7d0f0482c320 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:22.200986 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6dd42ac4-6c17-4034-8561-7d0f0482c320 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:22.202390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6dd42ac4-6c17-4034-8561-7d0f0482c320 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1407 microversion: 2.20 time: 0.510759 Aug 19 16:32:22.203337 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 35/69] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:21 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1407 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:22.369353 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b693da0b-6cd0-48da-969b-b3f099b76eab tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:22.371005 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-b693da0b-6cd0-48da-969b-b3f099b76eab tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:22.381354 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b693da0b-6cd0-48da-969b-b3f099b76eab tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:22.382242 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b693da0b-6cd0-48da-969b-b3f099b76eab tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:22.383005 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b693da0b-6cd0-48da-969b-b3f099b76eab tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:22.384658 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b693da0b-6cd0-48da-969b-b3f099b76eab tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:22.385891 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b693da0b-6cd0-48da-969b-b3f099b76eab tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:22.387731 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b693da0b-6cd0-48da-969b-b3f099b76eab tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:22.491647 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b693da0b-6cd0-48da-969b-b3f099b76eab tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:22.502937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b693da0b-6cd0-48da-969b-b3f099b76eab tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1299 microversion: 2.1 time: 0.138560 Aug 19 16:32:22.504423 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 35/70] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:22 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1299 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:22.957072 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b025a6c2-9bec-4ab9-b8a6-6d464d512284 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:22.958101 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b025a6c2-9bec-4ab9-b8a6-6d464d512284 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:22.960998 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=6 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:22.971045 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b025a6c2-9bec-4ab9-b8a6-6d464d512284 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:22.976126 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b025a6c2-9bec-4ab9-b8a6-6d464d512284 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:22.976731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b025a6c2-9bec-4ab9-b8a6-6d464d512284 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:22.979346 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b025a6c2-9bec-4ab9-b8a6-6d464d512284 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:22.980051 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b025a6c2-9bec-4ab9-b8a6-6d464d512284 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:22.983157 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b025a6c2-9bec-4ab9-b8a6-6d464d512284 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:23.092355 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7973f4f1-d976-4555-b19d-eda905acecb6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:23.093601 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7973f4f1-d976-4555-b19d-eda905acecb6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:23.107537 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7973f4f1-d976-4555-b19d-eda905acecb6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:23.108029 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7973f4f1-d976-4555-b19d-eda905acecb6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:23.108465 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7973f4f1-d976-4555-b19d-eda905acecb6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:23.109218 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7973f4f1-d976-4555-b19d-eda905acecb6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:23.109657 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7973f4f1-d976-4555-b19d-eda905acecb6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:23.110073 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7973f4f1-d976-4555-b19d-eda905acecb6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:23.127875 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b025a6c2-9bec-4ab9-b8a6-6d464d512284 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:23.145323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b025a6c2-9bec-4ab9-b8a6-6d464d512284 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1273 microversion: 2.1 time: 0.192192 Aug 19 16:32:23.148861 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 36/71] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:22 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1273 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:23.206404 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f65457d1-1067-4ed2-93c6-897657df25dd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:23.207749 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f65457d1-1067-4ed2-93c6-897657df25dd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:23.219016 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f65457d1-1067-4ed2-93c6-897657df25dd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:23.220186 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f65457d1-1067-4ed2-93c6-897657df25dd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:23.221219 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f65457d1-1067-4ed2-93c6-897657df25dd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:23.222493 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f65457d1-1067-4ed2-93c6-897657df25dd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:23.223766 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f65457d1-1067-4ed2-93c6-897657df25dd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:23.224442 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f65457d1-1067-4ed2-93c6-897657df25dd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:23.234172 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7973f4f1-d976-4555-b19d-eda905acecb6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:23.247563 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7973f4f1-d976-4555-b19d-eda905acecb6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1281 microversion: 2.1 time: 0.160089 Aug 19 16:32:23.249389 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 36/72] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:23 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1281 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:23.261104 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-aa4f0af8-fded-475c-ad5f-f7f41b8084bf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:23.262092 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-aa4f0af8-fded-475c-ad5f-f7f41b8084bf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:23.281906 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-aa4f0af8-fded-475c-ad5f-f7f41b8084bf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:23.285629 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-aa4f0af8-fded-475c-ad5f-f7f41b8084bf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:23.286176 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-aa4f0af8-fded-475c-ad5f-f7f41b8084bf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:23.286947 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-aa4f0af8-fded-475c-ad5f-f7f41b8084bf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:23.287432 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-aa4f0af8-fded-475c-ad5f-f7f41b8084bf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:23.287889 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-aa4f0af8-fded-475c-ad5f-f7f41b8084bf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:23.395297 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f65457d1-1067-4ed2-93c6-897657df25dd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:23.400807 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=6 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:23.412687 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f65457d1-1067-4ed2-93c6-897657df25dd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1290 microversion: 2.1 time: 0.210880 Aug 19 16:32:23.436687 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 37/73] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:23 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1290 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:23.462792 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=32 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:23.502940 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-aa4f0af8-fded-475c-ad5f-f7f41b8084bf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:23.517702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-aa4f0af8-fded-475c-ad5f-f7f41b8084bf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:23.520697 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-aa4f0af8-fded-475c-ad5f-f7f41b8084bf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:23.522599 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-aa4f0af8-fded-475c-ad5f-f7f41b8084bf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1407 microversion: 2.20 time: 0.270730 Aug 19 16:32:23.523331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 37/74] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:23 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:23.545375 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-fd018066-9edd-4fa1-a6e5-82a51404369b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:23.546726 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-fd018066-9edd-4fa1-a6e5-82a51404369b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:23.564572 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fd018066-9edd-4fa1-a6e5-82a51404369b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:23.566799 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fd018066-9edd-4fa1-a6e5-82a51404369b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:23.567430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fd018066-9edd-4fa1-a6e5-82a51404369b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:23.569578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fd018066-9edd-4fa1-a6e5-82a51404369b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:23.570483 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fd018066-9edd-4fa1-a6e5-82a51404369b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:23.573953 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fd018066-9edd-4fa1-a6e5-82a51404369b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:23.705440 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=30 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:23.744014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fd018066-9edd-4fa1-a6e5-82a51404369b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:23.752011 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-fd018066-9edd-4fa1-a6e5-82a51404369b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1299 microversion: 2.1 time: 0.227399 Aug 19 16:32:23.752582 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 38/75] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:23 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1299 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:24.167970 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-3542b0fe-0ad5-41e7-8b6e-02e415d649b1 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:24.168629 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-3542b0fe-0ad5-41e7-8b6e-02e415d649b1 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:24.180312 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3542b0fe-0ad5-41e7-8b6e-02e415d649b1 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:24.182565 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3542b0fe-0ad5-41e7-8b6e-02e415d649b1 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:24.183244 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3542b0fe-0ad5-41e7-8b6e-02e415d649b1 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:24.184501 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3542b0fe-0ad5-41e7-8b6e-02e415d649b1 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:24.186232 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3542b0fe-0ad5-41e7-8b6e-02e415d649b1 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:24.188320 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3542b0fe-0ad5-41e7-8b6e-02e415d649b1 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:24.275409 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-7015a963-075b-4794-9ac8-b5ac7c53c18e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:24.278368 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-7015a963-075b-4794-9ac8-b5ac7c53c18e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:24.295987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7015a963-075b-4794-9ac8-b5ac7c53c18e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:24.296485 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7015a963-075b-4794-9ac8-b5ac7c53c18e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:24.300040 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7015a963-075b-4794-9ac8-b5ac7c53c18e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:24.301121 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7015a963-075b-4794-9ac8-b5ac7c53c18e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:24.301751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7015a963-075b-4794-9ac8-b5ac7c53c18e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:24.302287 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7015a963-075b-4794-9ac8-b5ac7c53c18e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:24.781184 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-3542b0fe-0ad5-41e7-8b6e-02e415d649b1 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:24.792049 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-3542b0fe-0ad5-41e7-8b6e-02e415d649b1 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1273 microversion: 2.1 time: 0.627482 Aug 19 16:32:24.798153 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 38/76] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:24 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1273 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:24.803014 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-abe4103b-886c-4056-abee-b3e7c3ff7692 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:24.809707 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-abe4103b-886c-4056-abee-b3e7c3ff7692 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:24.825669 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-abe4103b-886c-4056-abee-b3e7c3ff7692 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:24.826480 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-abe4103b-886c-4056-abee-b3e7c3ff7692 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:24.827092 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-abe4103b-886c-4056-abee-b3e7c3ff7692 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:24.827961 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-abe4103b-886c-4056-abee-b3e7c3ff7692 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:24.828589 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-abe4103b-886c-4056-abee-b3e7c3ff7692 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:24.829228 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-abe4103b-886c-4056-abee-b3e7c3ff7692 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:24.900789 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-abe4103b-886c-4056-abee-b3e7c3ff7692 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:24.910391 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-abe4103b-886c-4056-abee-b3e7c3ff7692 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1308 microversion: 2.1 time: 0.110913 Aug 19 16:32:24.911279 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 39/77] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:24 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:24.917129 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-239f94c2-1f04-4d74-acbe-16f25cf46940 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:24.918184 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-239f94c2-1f04-4d74-acbe-16f25cf46940 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:24.928545 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-239f94c2-1f04-4d74-acbe-16f25cf46940 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:24.930078 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-239f94c2-1f04-4d74-acbe-16f25cf46940 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:24.930768 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-239f94c2-1f04-4d74-acbe-16f25cf46940 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:24.931683 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-239f94c2-1f04-4d74-acbe-16f25cf46940 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:24.932692 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-239f94c2-1f04-4d74-acbe-16f25cf46940 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:24.933364 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-239f94c2-1f04-4d74-acbe-16f25cf46940 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:25.233790 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-239f94c2-1f04-4d74-acbe-16f25cf46940 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:25.246131 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-239f94c2-1f04-4d74-acbe-16f25cf46940 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:25.256208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-239f94c2-1f04-4d74-acbe-16f25cf46940 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:25.258485 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-239f94c2-1f04-4d74-acbe-16f25cf46940 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1407 microversion: 2.20 time: 0.345937 Aug 19 16:32:25.262211 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 40/78] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:24 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1407 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:25.273637 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-440b12cd-110d-4656-97c0-3ee654c23e66 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:25.277513 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-440b12cd-110d-4656-97c0-3ee654c23e66 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:25.289581 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-440b12cd-110d-4656-97c0-3ee654c23e66 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:25.292928 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-440b12cd-110d-4656-97c0-3ee654c23e66 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:25.295082 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-440b12cd-110d-4656-97c0-3ee654c23e66 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:25.296902 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-440b12cd-110d-4656-97c0-3ee654c23e66 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:25.298093 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-440b12cd-110d-4656-97c0-3ee654c23e66 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:25.302898 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-440b12cd-110d-4656-97c0-3ee654c23e66 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:25.443751 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-440b12cd-110d-4656-97c0-3ee654c23e66 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:25.455634 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-440b12cd-110d-4656-97c0-3ee654c23e66 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1297 microversion: 2.1 time: 0.191398 Aug 19 16:32:25.469420 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 41/79] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:25 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1297 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:25.636463 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7015a963-075b-4794-9ac8-b5ac7c53c18e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:25.674135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-7015a963-075b-4794-9ac8-b5ac7c53c18e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1281 microversion: 2.1 time: 1.404283 Aug 19 16:32:25.677782 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 39/80] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:24 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1281 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:25.823475 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-72f7f34c-23e6-4f44-b814-604912958fc2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:25.824648 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-72f7f34c-23e6-4f44-b814-604912958fc2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:25.837216 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-72f7f34c-23e6-4f44-b814-604912958fc2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:25.842599 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-72f7f34c-23e6-4f44-b814-604912958fc2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:25.844215 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-72f7f34c-23e6-4f44-b814-604912958fc2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:25.845487 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-72f7f34c-23e6-4f44-b814-604912958fc2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:25.847488 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-72f7f34c-23e6-4f44-b814-604912958fc2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:25.848098 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-72f7f34c-23e6-4f44-b814-604912958fc2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:25.943336 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3bf460b4-cb09-482d-a603-29cf34d70266 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:25.944134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-3bf460b4-cb09-482d-a603-29cf34d70266 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:25.996417 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-72f7f34c-23e6-4f44-b814-604912958fc2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:25.996955 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3bf460b4-cb09-482d-a603-29cf34d70266 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:25.999624 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3bf460b4-cb09-482d-a603-29cf34d70266 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:26.005155 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3bf460b4-cb09-482d-a603-29cf34d70266 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:26.007631 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3bf460b4-cb09-482d-a603-29cf34d70266 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:26.013956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-72f7f34c-23e6-4f44-b814-604912958fc2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1273 microversion: 2.1 time: 0.194699 Aug 19 16:32:26.016057 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 42/81] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:25 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1273 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:26.016675 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3bf460b4-cb09-482d-a603-29cf34d70266 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:26.017758 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3bf460b4-cb09-482d-a603-29cf34d70266 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:26.289487 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-42e2fdd0-0a02-4ba3-8596-1e674c31e351 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:26.291871 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-42e2fdd0-0a02-4ba3-8596-1e674c31e351 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:26.311712 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-42e2fdd0-0a02-4ba3-8596-1e674c31e351 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:26.314004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-42e2fdd0-0a02-4ba3-8596-1e674c31e351 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:26.315720 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-42e2fdd0-0a02-4ba3-8596-1e674c31e351 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:26.317205 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-42e2fdd0-0a02-4ba3-8596-1e674c31e351 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:26.320091 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-42e2fdd0-0a02-4ba3-8596-1e674c31e351 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:26.321482 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-42e2fdd0-0a02-4ba3-8596-1e674c31e351 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:26.411377 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-3bf460b4-cb09-482d-a603-29cf34d70266 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:26.429325 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3bf460b4-cb09-482d-a603-29cf34d70266 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1308 microversion: 2.1 time: 0.497350 Aug 19 16:32:26.430199 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 40/82] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:25 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1308 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:26.479537 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-748b6377-fc2e-4cb1-a30f-f64efb34bdcf tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:26.480543 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-748b6377-fc2e-4cb1-a30f-f64efb34bdcf tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:26.497589 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-748b6377-fc2e-4cb1-a30f-f64efb34bdcf tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:26.498009 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-748b6377-fc2e-4cb1-a30f-f64efb34bdcf tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:26.498632 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-748b6377-fc2e-4cb1-a30f-f64efb34bdcf tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:26.499503 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-748b6377-fc2e-4cb1-a30f-f64efb34bdcf tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:26.500250 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-748b6377-fc2e-4cb1-a30f-f64efb34bdcf tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:26.500831 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-748b6377-fc2e-4cb1-a30f-f64efb34bdcf tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:26.746513 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-42e2fdd0-0a02-4ba3-8596-1e674c31e351 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:26.750377 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-748b6377-fc2e-4cb1-a30f-f64efb34bdcf tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:26.761617 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-748b6377-fc2e-4cb1-a30f-f64efb34bdcf tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1297 microversion: 2.1 time: 0.285918 Aug 19 16:32:26.762382 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-42e2fdd0-0a02-4ba3-8596-1e674c31e351 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:26.764205 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 41/83] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:26 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1297 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:26.767719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-42e2fdd0-0a02-4ba3-8596-1e674c31e351 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:26.771652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-42e2fdd0-0a02-4ba3-8596-1e674c31e351 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1407 microversion: 2.20 time: 0.485365 Aug 19 16:32:26.773656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-154ab621-f909-49de-9fc2-d703269c4169 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:26.774269 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-154ab621-f909-49de-9fc2-d703269c4169 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:26.774518 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 43/84] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:26 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:26.792800 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-154ab621-f909-49de-9fc2-d703269c4169 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:26.793466 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-154ab621-f909-49de-9fc2-d703269c4169 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:26.794162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-154ab621-f909-49de-9fc2-d703269c4169 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:26.796193 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-154ab621-f909-49de-9fc2-d703269c4169 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:26.798757 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-154ab621-f909-49de-9fc2-d703269c4169 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:26.800451 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-154ab621-f909-49de-9fc2-d703269c4169 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:27.033948 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-154ab621-f909-49de-9fc2-d703269c4169 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:27.037150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-af8eeb7e-f959-47f4-b9c4-936ce860edda tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:27.037768 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-af8eeb7e-f959-47f4-b9c4-936ce860edda tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:27.046539 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-154ab621-f909-49de-9fc2-d703269c4169 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1279 microversion: 2.1 time: 0.281239 Aug 19 16:32:27.051431 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-af8eeb7e-f959-47f4-b9c4-936ce860edda tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:27.052566 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-af8eeb7e-f959-47f4-b9c4-936ce860edda tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:27.056270 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 42/85] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:26 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1279 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:27.073357 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-af8eeb7e-f959-47f4-b9c4-936ce860edda tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:27.074163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-af8eeb7e-f959-47f4-b9c4-936ce860edda tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:27.074856 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-af8eeb7e-f959-47f4-b9c4-936ce860edda tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:27.075080 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-af8eeb7e-f959-47f4-b9c4-936ce860edda tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:27.438576 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-af8eeb7e-f959-47f4-b9c4-936ce860edda tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:27.454569 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ad9aaacc-48c6-449b-b12f-51f6ba3daa7d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:27.455576 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ad9aaacc-48c6-449b-b12f-51f6ba3daa7d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:27.478430 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-af8eeb7e-f959-47f4-b9c4-936ce860edda tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1273 microversion: 2.1 time: 0.445333 Aug 19 16:32:27.487162 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 44/86] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:27 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1273 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:27.488005 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad9aaacc-48c6-449b-b12f-51f6ba3daa7d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:27.488863 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad9aaacc-48c6-449b-b12f-51f6ba3daa7d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:27.489569 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad9aaacc-48c6-449b-b12f-51f6ba3daa7d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:27.490882 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad9aaacc-48c6-449b-b12f-51f6ba3daa7d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:27.491512 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad9aaacc-48c6-449b-b12f-51f6ba3daa7d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:27.492107 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad9aaacc-48c6-449b-b12f-51f6ba3daa7d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:27.633506 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ad9aaacc-48c6-449b-b12f-51f6ba3daa7d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:27.646022 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ad9aaacc-48c6-449b-b12f-51f6ba3daa7d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1296 microversion: 2.1 time: 0.198107 Aug 19 16:32:27.646916 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 43/87] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:27 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1296 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:27.788964 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-9b56a24d-f9d9-48b4-9e61-dfc6402784a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:27.797030 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6518c8d0-327e-43cf-8770-8412072f9c0b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:27.797636 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6518c8d0-327e-43cf-8770-8412072f9c0b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:27.800221 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-9b56a24d-f9d9-48b4-9e61-dfc6402784a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:27.809790 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6518c8d0-327e-43cf-8770-8412072f9c0b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:27.810321 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6518c8d0-327e-43cf-8770-8412072f9c0b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:27.812320 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6518c8d0-327e-43cf-8770-8412072f9c0b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:27.812320 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6518c8d0-327e-43cf-8770-8412072f9c0b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:27.812320 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6518c8d0-327e-43cf-8770-8412072f9c0b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:27.812320 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6518c8d0-327e-43cf-8770-8412072f9c0b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:27.819093 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9b56a24d-f9d9-48b4-9e61-dfc6402784a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:27.819889 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9b56a24d-f9d9-48b4-9e61-dfc6402784a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:27.820637 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9b56a24d-f9d9-48b4-9e61-dfc6402784a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:27.823124 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9b56a24d-f9d9-48b4-9e61-dfc6402784a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:27.823794 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9b56a24d-f9d9-48b4-9e61-dfc6402784a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:27.825471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9b56a24d-f9d9-48b4-9e61-dfc6402784a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:28.078999 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-9b56a24d-f9d9-48b4-9e61-dfc6402784a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:28.096092 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-9b56a24d-f9d9-48b4-9e61-dfc6402784a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1297 microversion: 2.1 time: 0.313523 Aug 19 16:32:28.113352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 45/88] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:27 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1297 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:28.131632 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-397b6857-a400-4e1f-9729-09a969959ebc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:28.132269 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-397b6857-a400-4e1f-9729-09a969959ebc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:28.149606 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-397b6857-a400-4e1f-9729-09a969959ebc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:28.150052 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-397b6857-a400-4e1f-9729-09a969959ebc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:28.151435 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-397b6857-a400-4e1f-9729-09a969959ebc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:28.152254 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-397b6857-a400-4e1f-9729-09a969959ebc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:28.152804 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-397b6857-a400-4e1f-9729-09a969959ebc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:28.155856 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-397b6857-a400-4e1f-9729-09a969959ebc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:28.214533 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=100 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:28.720147 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6518c8d0-327e-43cf-8770-8412072f9c0b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:28.749429 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6518c8d0-327e-43cf-8770-8412072f9c0b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:28.755344 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6518c8d0-327e-43cf-8770-8412072f9c0b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:28.759388 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6518c8d0-327e-43cf-8770-8412072f9c0b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1407 microversion: 2.20 time: 0.965754 Aug 19 16:32:28.761278 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 44/89] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:27 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1407 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:28.779328 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-397b6857-a400-4e1f-9729-09a969959ebc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:28.779807 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-76e55ebb-78bb-4821-8774-c7f046258685 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:28.781643 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-76e55ebb-78bb-4821-8774-c7f046258685 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:28.797347 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-397b6857-a400-4e1f-9729-09a969959ebc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1321 microversion: 2.1 time: 0.679189 Aug 19 16:32:28.809501 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 46/90] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:28 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1321 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:28.809829 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76e55ebb-78bb-4821-8774-c7f046258685 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:28.809829 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76e55ebb-78bb-4821-8774-c7f046258685 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:28.809829 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76e55ebb-78bb-4821-8774-c7f046258685 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:28.809829 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76e55ebb-78bb-4821-8774-c7f046258685 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:28.812036 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76e55ebb-78bb-4821-8774-c7f046258685 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:28.812627 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76e55ebb-78bb-4821-8774-c7f046258685 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:28.814594 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-99d877b4-6480-4de3-8110-83075fe8012a tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:28.815162 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-99d877b4-6480-4de3-8110-83075fe8012a tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:28.823935 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-99d877b4-6480-4de3-8110-83075fe8012a tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:28.824607 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-99d877b4-6480-4de3-8110-83075fe8012a tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:28.825093 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-99d877b4-6480-4de3-8110-83075fe8012a tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:28.825806 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-99d877b4-6480-4de3-8110-83075fe8012a tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:28.826259 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-99d877b4-6480-4de3-8110-83075fe8012a tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:28.826682 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-99d877b4-6480-4de3-8110-83075fe8012a tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:29.089825 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-99d877b4-6480-4de3-8110-83075fe8012a tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:29.105519 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-99d877b4-6480-4de3-8110-83075fe8012a tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1296 microversion: 2.1 time: 0.306197 Aug 19 16:32:29.106407 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 47/91] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:28 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1296 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:29.123841 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-824b0495-36d4-4e56-b0b5-1c8e56904a41 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:29.124815 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-824b0495-36d4-4e56-b0b5-1c8e56904a41 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:29.131763 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-824b0495-36d4-4e56-b0b5-1c8e56904a41 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:29.133629 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-824b0495-36d4-4e56-b0b5-1c8e56904a41 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:29.134285 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-824b0495-36d4-4e56-b0b5-1c8e56904a41 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:29.136009 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-824b0495-36d4-4e56-b0b5-1c8e56904a41 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:29.136689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-824b0495-36d4-4e56-b0b5-1c8e56904a41 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:29.137314 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-824b0495-36d4-4e56-b0b5-1c8e56904a41 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:29.274701 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-824b0495-36d4-4e56-b0b5-1c8e56904a41 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:29.301604 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-824b0495-36d4-4e56-b0b5-1c8e56904a41 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1297 microversion: 2.1 time: 0.185637 Aug 19 16:32:29.302470 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 48/92] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:29 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1297 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:29.313447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-76e55ebb-78bb-4821-8774-c7f046258685 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:29.325025 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-76e55ebb-78bb-4821-8774-c7f046258685 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1315 microversion: 2.1 time: 0.560318 Aug 19 16:32:29.326416 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 45/93] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:28 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1315 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:29.784633 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-4f4add26-3229-4b23-acb3-72b20be9f248 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:29.785969 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-4f4add26-3229-4b23-acb3-72b20be9f248 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:29.799539 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f4add26-3229-4b23-acb3-72b20be9f248 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:29.800362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f4add26-3229-4b23-acb3-72b20be9f248 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:29.805135 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f4add26-3229-4b23-acb3-72b20be9f248 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:29.816095 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f4add26-3229-4b23-acb3-72b20be9f248 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:29.817901 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f4add26-3229-4b23-acb3-72b20be9f248 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:29.819660 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2988bea3-101f-434c-a095-dad66067381e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:29.820334 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2988bea3-101f-434c-a095-dad66067381e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:29.821024 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f4add26-3229-4b23-acb3-72b20be9f248 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:29.831357 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2988bea3-101f-434c-a095-dad66067381e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:29.832817 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2988bea3-101f-434c-a095-dad66067381e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:29.833279 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2988bea3-101f-434c-a095-dad66067381e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:29.838808 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2988bea3-101f-434c-a095-dad66067381e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:29.839285 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2988bea3-101f-434c-a095-dad66067381e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:29.839820 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2988bea3-101f-434c-a095-dad66067381e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:30.310500 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2988bea3-101f-434c-a095-dad66067381e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:30.328005 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2988bea3-101f-434c-a095-dad66067381e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1321 microversion: 2.1 time: 0.512196 Aug 19 16:32:30.334762 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 46/94] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:29 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1321 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:30.356928 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f4cc152d-e89f-467a-b990-981e93475723 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:30.362635 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f4cc152d-e89f-467a-b990-981e93475723 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:30.381630 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f4cc152d-e89f-467a-b990-981e93475723 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:30.383013 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f4cc152d-e89f-467a-b990-981e93475723 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:30.384197 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f4cc152d-e89f-467a-b990-981e93475723 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:30.387656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f4cc152d-e89f-467a-b990-981e93475723 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:30.388793 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f4cc152d-e89f-467a-b990-981e93475723 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:30.390614 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f4cc152d-e89f-467a-b990-981e93475723 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:30.531270 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=100 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:30.928203 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-4f4add26-3229-4b23-acb3-72b20be9f248 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:30.945868 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-4f4add26-3229-4b23-acb3-72b20be9f248 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:30.949800 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-4f4add26-3229-4b23-acb3-72b20be9f248 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:30.951484 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-4f4add26-3229-4b23-acb3-72b20be9f248 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1407 microversion: 2.20 time: 1.171875 Aug 19 16:32:30.967396 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 49/95] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:29 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1407 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:30.967396 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-598d1cfe-03bf-44e3-899a-c7ee930e6aff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:30.967396 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-598d1cfe-03bf-44e3-899a-c7ee930e6aff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:30.970232 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-598d1cfe-03bf-44e3-899a-c7ee930e6aff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:30.970916 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-598d1cfe-03bf-44e3-899a-c7ee930e6aff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:30.971672 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-598d1cfe-03bf-44e3-899a-c7ee930e6aff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:30.972805 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-598d1cfe-03bf-44e3-899a-c7ee930e6aff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:30.973352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-598d1cfe-03bf-44e3-899a-c7ee930e6aff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:30.973784 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-598d1cfe-03bf-44e3-899a-c7ee930e6aff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:31.432496 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f4cc152d-e89f-467a-b990-981e93475723 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:31.441149 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f4cc152d-e89f-467a-b990-981e93475723 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 1.104421 Aug 19 16:32:31.442196 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 47/96] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:30 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:31.447112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-59baa347-de48-47ef-94a3-3717fcc1a906 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:31.448420 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-59baa347-de48-47ef-94a3-3717fcc1a906 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:31.455985 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-59baa347-de48-47ef-94a3-3717fcc1a906 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:31.456728 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-59baa347-de48-47ef-94a3-3717fcc1a906 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:31.457492 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-59baa347-de48-47ef-94a3-3717fcc1a906 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:31.458423 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-59baa347-de48-47ef-94a3-3717fcc1a906 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:31.458952 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-59baa347-de48-47ef-94a3-3717fcc1a906 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:31.459471 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-59baa347-de48-47ef-94a3-3717fcc1a906 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:31.647558 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-598d1cfe-03bf-44e3-899a-c7ee930e6aff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:31.665738 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-598d1cfe-03bf-44e3-899a-c7ee930e6aff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1364 microversion: 2.1 time: 0.711310 Aug 19 16:32:31.667328 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 50/97] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:30 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1364 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:31.825777 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-3de0c186-f93e-4639-890b-ccc5fce61f47 req-2a5f925c-b977-4e4e-b9f2-f13f19e35159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "894cc1e2-8a17-4de0-8127-b929095837d8", "tag": "72e0a5f4-4545-47a6-8d9a-ae53acb35877"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:31.839188 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-3de0c186-f93e-4639-890b-ccc5fce61f47 req-2a5f925c-b977-4e4e-b9f2-f13f19e35159 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:31.839846 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-3de0c186-f93e-4639-890b-ccc5fce61f47 req-2a5f925c-b977-4e4e-b9f2-f13f19e35159 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:31.840600 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-3de0c186-f93e-4639-890b-ccc5fce61f47 req-2a5f925c-b977-4e4e-b9f2-f13f19e35159 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:31.863705 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-3de0c186-f93e-4639-890b-ccc5fce61f47 req-2a5f925c-b977-4e4e-b9f2-f13f19e35159 service nova] Creating event network-changed:72e0a5f4-4545-47a6-8d9a-ae53acb35877 for instance 894cc1e2-8a17-4de0-8127-b929095837d8 on hv-cinder-83124 Aug 19 16:32:31.864228 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-3de0c186-f93e-4639-890b-ccc5fce61f47 req-2a5f925c-b977-4e4e-b9f2-f13f19e35159 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127284) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 19 16:32:31.864614 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-3de0c186-f93e-4639-890b-ccc5fce61f47 req-2a5f925c-b977-4e4e-b9f2-f13f19e35159 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127284) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 19 16:32:31.865668 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-efbc72fa-14d2-40b4-ae3e-0a213094c8e3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:31.866334 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-efbc72fa-14d2-40b4-ae3e-0a213094c8e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:31.866759 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-efbc72fa-14d2-40b4-ae3e-0a213094c8e3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:31.867521 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-efbc72fa-14d2-40b4-ae3e-0a213094c8e3 None None] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:31.867972 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-efbc72fa-14d2-40b4-ae3e-0a213094c8e3 None None] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:31.868389 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-efbc72fa-14d2-40b4-ae3e-0a213094c8e3 None None] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:31.878359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.compute.rpcapi [None req-efbc72fa-14d2-40b4-ae3e-0a213094c8e3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 19 16:32:31.879261 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-efbc72fa-14d2-40b4-ae3e-0a213094c8e3 None None] Releasing lock "compute-rpcapi-router" {{(pid=127284) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 19 16:32:31.903021 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-efbc72fa-14d2-40b4-ae3e-0a213094c8e3 None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233542 Aug 19 16:32:31.904160 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 51/98] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:32:32.002404 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-e54c7454-0b5a-4aca-83bb-cc4691012512 req-c2270a1c-8d13-4b9a-a00f-5067d56c56e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73fc9558-1f91-4cbd-b5f1-9342dc7d6148", "tag": "1a92f5a0-de60-40bf-b6d4-a7c9883868ba"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:32.024328 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-e54c7454-0b5a-4aca-83bb-cc4691012512 req-c2270a1c-8d13-4b9a-a00f-5067d56c56e0 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:32.025196 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-e54c7454-0b5a-4aca-83bb-cc4691012512 req-c2270a1c-8d13-4b9a-a00f-5067d56c56e0 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:32.027865 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-e54c7454-0b5a-4aca-83bb-cc4691012512 req-c2270a1c-8d13-4b9a-a00f-5067d56c56e0 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:32.040542 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-e54c7454-0b5a-4aca-83bb-cc4691012512 req-c2270a1c-8d13-4b9a-a00f-5067d56c56e0 service nova] Creating event network-changed:1a92f5a0-de60-40bf-b6d4-a7c9883868ba for instance 73fc9558-1f91-4cbd-b5f1-9342dc7d6148 on hv-cinder-83124 Aug 19 16:32:32.046443 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-e54c7454-0b5a-4aca-83bb-cc4691012512 req-c2270a1c-8d13-4b9a-a00f-5067d56c56e0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140680 Aug 19 16:32:32.047656 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 52/99] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:32:32.053350 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8c6730b4-8b33-4fd7-9418-893666e69ad0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:32.054364 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8c6730b4-8b33-4fd7-9418-893666e69ad0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:32.061584 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8c6730b4-8b33-4fd7-9418-893666e69ad0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:32.062398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8c6730b4-8b33-4fd7-9418-893666e69ad0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:32.063051 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8c6730b4-8b33-4fd7-9418-893666e69ad0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:32.063964 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8c6730b4-8b33-4fd7-9418-893666e69ad0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:32.064725 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8c6730b4-8b33-4fd7-9418-893666e69ad0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:32.065639 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8c6730b4-8b33-4fd7-9418-893666e69ad0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:32.161607 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-59baa347-de48-47ef-94a3-3717fcc1a906 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:32.173018 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-59baa347-de48-47ef-94a3-3717fcc1a906 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1315 microversion: 2.1 time: 0.729481 Aug 19 16:32:32.185764 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 48/100] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:31 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1315 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:32.185764 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-74bd0fdc-bfa1-49a5-a0af-306629f441c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:32.185764 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-74bd0fdc-bfa1-49a5-a0af-306629f441c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:32.188858 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-74bd0fdc-bfa1-49a5-a0af-306629f441c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:32.189578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-74bd0fdc-bfa1-49a5-a0af-306629f441c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:32.190684 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-74bd0fdc-bfa1-49a5-a0af-306629f441c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:32.191507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-74bd0fdc-bfa1-49a5-a0af-306629f441c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:32.192168 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-74bd0fdc-bfa1-49a5-a0af-306629f441c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:32.192818 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-74bd0fdc-bfa1-49a5-a0af-306629f441c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:32.669117 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-74bd0fdc-bfa1-49a5-a0af-306629f441c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:32.683960 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8c6730b4-8b33-4fd7-9418-893666e69ad0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:32.686877 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-74bd0fdc-bfa1-49a5-a0af-306629f441c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:32.689054 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-74bd0fdc-bfa1-49a5-a0af-306629f441c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:32.690264 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-74bd0fdc-bfa1-49a5-a0af-306629f441c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1407 microversion: 2.20 time: 0.513872 Aug 19 16:32:32.690901 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 49/101] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:32 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1407 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:32.695691 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-60b60776-902e-4d2b-9e28-9d28257110f8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:32.696262 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-60b60776-902e-4d2b-9e28-9d28257110f8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:32.702918 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-60b60776-902e-4d2b-9e28-9d28257110f8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:32.703476 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-60b60776-902e-4d2b-9e28-9d28257110f8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:32.704129 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-60b60776-902e-4d2b-9e28-9d28257110f8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:32.705055 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-60b60776-902e-4d2b-9e28-9d28257110f8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:32.705696 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-60b60776-902e-4d2b-9e28-9d28257110f8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:32.706317 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-60b60776-902e-4d2b-9e28-9d28257110f8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:32.709894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8c6730b4-8b33-4fd7-9418-893666e69ad0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1321 microversion: 2.1 time: 0.660640 Aug 19 16:32:32.719389 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 53/102] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:32 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1321 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:32.719389 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-39146f76-fda8-46a8-a4f6-82c90dad15ac tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:32.719389 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-39146f76-fda8-46a8-a4f6-82c90dad15ac tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:32.736513 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39146f76-fda8-46a8-a4f6-82c90dad15ac tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:32.737023 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39146f76-fda8-46a8-a4f6-82c90dad15ac tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:32.737494 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39146f76-fda8-46a8-a4f6-82c90dad15ac tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:32.738165 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39146f76-fda8-46a8-a4f6-82c90dad15ac tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:32.738613 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39146f76-fda8-46a8-a4f6-82c90dad15ac tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:32.739030 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39146f76-fda8-46a8-a4f6-82c90dad15ac tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:32.936409 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-60b60776-902e-4d2b-9e28-9d28257110f8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:32.948933 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-60b60776-902e-4d2b-9e28-9d28257110f8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 0.255052 Aug 19 16:32:32.968879 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 50/103] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:32 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:33.036447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-39146f76-fda8-46a8-a4f6-82c90dad15ac tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:33.050820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-39146f76-fda8-46a8-a4f6-82c90dad15ac tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1364 microversion: 2.1 time: 0.337537 Aug 19 16:32:33.051404 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 54/104] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:32 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1364 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:33.201341 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-9f86593c-95de-43e4-804a-27c9784ce736 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:33.202252 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-9f86593c-95de-43e4-804a-27c9784ce736 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:33.209018 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f86593c-95de-43e4-804a-27c9784ce736 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:33.209572 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f86593c-95de-43e4-804a-27c9784ce736 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:33.210476 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f86593c-95de-43e4-804a-27c9784ce736 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:33.211258 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f86593c-95de-43e4-804a-27c9784ce736 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:33.211788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f86593c-95de-43e4-804a-27c9784ce736 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:33.212320 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f86593c-95de-43e4-804a-27c9784ce736 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:33.362635 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-9f86593c-95de-43e4-804a-27c9784ce736 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:33.370797 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-9f86593c-95de-43e4-804a-27c9784ce736 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1315 microversion: 2.1 time: 0.173424 Aug 19 16:32:33.371371 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 51/105] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:33 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:33.722610 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-3a3a39dc-903f-4c05-afb1-5cff317788a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:33.723121 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-3a3a39dc-903f-4c05-afb1-5cff317788a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:33.731149 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a3a39dc-903f-4c05-afb1-5cff317788a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:33.735036 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a3a39dc-903f-4c05-afb1-5cff317788a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:33.735607 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a3a39dc-903f-4c05-afb1-5cff317788a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:33.736435 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a3a39dc-903f-4c05-afb1-5cff317788a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:33.736931 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a3a39dc-903f-4c05-afb1-5cff317788a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:33.737855 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-167d30a8-b5d0-4b7f-87fd-a6a825bc0ad7 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:33.738948 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-167d30a8-b5d0-4b7f-87fd-a6a825bc0ad7 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:33.739675 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a3a39dc-903f-4c05-afb1-5cff317788a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:33.755326 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-167d30a8-b5d0-4b7f-87fd-a6a825bc0ad7 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:33.756731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-167d30a8-b5d0-4b7f-87fd-a6a825bc0ad7 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:33.757886 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-167d30a8-b5d0-4b7f-87fd-a6a825bc0ad7 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:33.766320 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-167d30a8-b5d0-4b7f-87fd-a6a825bc0ad7 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:33.768734 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-167d30a8-b5d0-4b7f-87fd-a6a825bc0ad7 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:33.769303 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-167d30a8-b5d0-4b7f-87fd-a6a825bc0ad7 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:34.022381 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-3a3a39dc-903f-4c05-afb1-5cff317788a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:34.030850 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-3a3a39dc-903f-4c05-afb1-5cff317788a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:34.032490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-3a3a39dc-903f-4c05-afb1-5cff317788a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:34.034222 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-3a3a39dc-903f-4c05-afb1-5cff317788a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1407 microversion: 2.20 time: 0.320073 Aug 19 16:32:34.049839 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 55/106] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:33 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1407 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:34.057016 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-8575e5d8-bd30-4cfb-9a88-f5440f976e6e req-13d59d95-ab93-4d42-8d0a-3952bf0b175d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "665dc524-b20c-4aa5-8861-13ad96d28939", "tag": "bb51172e-dc0e-4fcc-b012-110d88786f10"}, {"name": "network-changed", "server_uuid": "9f1f3d4e-7c83-4d2b-a34f-4cac4b871285", "tag": "36d1a484-663f-4e9f-a220-92a99deec85f"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:34.067263 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-167d30a8-b5d0-4b7f-87fd-a6a825bc0ad7 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:34.073811 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-8575e5d8-bd30-4cfb-9a88-f5440f976e6e req-13d59d95-ab93-4d42-8d0a-3952bf0b175d service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:34.074594 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-8575e5d8-bd30-4cfb-9a88-f5440f976e6e req-13d59d95-ab93-4d42-8d0a-3952bf0b175d service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:34.075466 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-8575e5d8-bd30-4cfb-9a88-f5440f976e6e req-13d59d95-ab93-4d42-8d0a-3952bf0b175d service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:34.075847 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-167d30a8-b5d0-4b7f-87fd-a6a825bc0ad7 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1321 microversion: 2.1 time: 0.344386 Aug 19 16:32:34.076419 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 52/107] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:33 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:34.081946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-918751e2-5a81-40ce-a559-69433b9f789b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:34.082663 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-918751e2-5a81-40ce-a559-69433b9f789b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:34.089072 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-918751e2-5a81-40ce-a559-69433b9f789b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:34.089759 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-918751e2-5a81-40ce-a559-69433b9f789b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:34.090348 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-918751e2-5a81-40ce-a559-69433b9f789b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:34.091605 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-918751e2-5a81-40ce-a559-69433b9f789b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:34.092206 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-918751e2-5a81-40ce-a559-69433b9f789b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:34.092795 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-918751e2-5a81-40ce-a559-69433b9f789b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:34.105648 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-8575e5d8-bd30-4cfb-9a88-f5440f976e6e req-13d59d95-ab93-4d42-8d0a-3952bf0b175d service nova] Creating event network-changed:bb51172e-dc0e-4fcc-b012-110d88786f10 for instance 665dc524-b20c-4aa5-8861-13ad96d28939 on hv-cinder-83124 Aug 19 16:32:34.106198 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-8575e5d8-bd30-4cfb-9a88-f5440f976e6e req-13d59d95-ab93-4d42-8d0a-3952bf0b175d service nova] Creating event network-changed:36d1a484-663f-4e9f-a220-92a99deec85f for instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 on hv-cinder-83124 Aug 19 16:32:34.113177 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-8575e5d8-bd30-4cfb-9a88-f5440f976e6e req-13d59d95-ab93-4d42-8d0a-3952bf0b175d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.061151 Aug 19 16:32:34.113773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 56/108] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:32:34.121386 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-246c7d2c-09e9-4a22-b71e-b84410590cd9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:34.122287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-246c7d2c-09e9-4a22-b71e-b84410590cd9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:34.129228 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-246c7d2c-09e9-4a22-b71e-b84410590cd9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:34.129712 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-246c7d2c-09e9-4a22-b71e-b84410590cd9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:34.130140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-246c7d2c-09e9-4a22-b71e-b84410590cd9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:34.131160 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-246c7d2c-09e9-4a22-b71e-b84410590cd9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:34.131620 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-246c7d2c-09e9-4a22-b71e-b84410590cd9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:34.132031 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-246c7d2c-09e9-4a22-b71e-b84410590cd9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:34.252986 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-918751e2-5a81-40ce-a559-69433b9f789b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:34.264558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-918751e2-5a81-40ce-a559-69433b9f789b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 0.186902 Aug 19 16:32:34.266045 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 53/109] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:34 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:34.270655 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-df32d9a8-becd-4a02-b12d-db5beb64711d req-c00bc1f8-dc31-4718-812d-7d920ec53d79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33d89321-9f57-4555-b081-9aacd51fba08", "tag": "c546c8c9-4520-43bf-97d3-35760918599b"}, {"name": "network-changed", "server_uuid": "a1eddf01-3fc7-4c5c-8560-96cddb34a199", "tag": "f7152602-0c68-468a-8871-72cc6f1ab0dc"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:34.285088 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-df32d9a8-becd-4a02-b12d-db5beb64711d req-c00bc1f8-dc31-4718-812d-7d920ec53d79 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:34.285965 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-df32d9a8-becd-4a02-b12d-db5beb64711d req-c00bc1f8-dc31-4718-812d-7d920ec53d79 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:34.286562 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-df32d9a8-becd-4a02-b12d-db5beb64711d req-c00bc1f8-dc31-4718-812d-7d920ec53d79 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:34.299089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-246c7d2c-09e9-4a22-b71e-b84410590cd9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:34.308174 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-246c7d2c-09e9-4a22-b71e-b84410590cd9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1364 microversion: 2.1 time: 0.192982 Aug 19 16:32:34.309898 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 57/110] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:34 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:34.312973 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-df32d9a8-becd-4a02-b12d-db5beb64711d req-c00bc1f8-dc31-4718-812d-7d920ec53d79 service nova] Creating event network-changed:c546c8c9-4520-43bf-97d3-35760918599b for instance 33d89321-9f57-4555-b081-9aacd51fba08 on hv-cinder-83124 Aug 19 16:32:34.313574 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-df32d9a8-becd-4a02-b12d-db5beb64711d req-c00bc1f8-dc31-4718-812d-7d920ec53d79 service nova] Creating event network-changed:f7152602-0c68-468a-8871-72cc6f1ab0dc for instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 on hv-cinder-83124 Aug 19 16:32:34.314163 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-df32d9a8-becd-4a02-b12d-db5beb64711d req-c00bc1f8-dc31-4718-812d-7d920ec53d79 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127285) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 19 16:32:34.314705 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-df32d9a8-becd-4a02-b12d-db5beb64711d req-c00bc1f8-dc31-4718-812d-7d920ec53d79 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127285) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 19 16:32:34.315752 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4aed3b3c-66d1-4e1e-a9e3-72472be43006 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:34.316211 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4aed3b3c-66d1-4e1e-a9e3-72472be43006 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:34.317308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4aed3b3c-66d1-4e1e-a9e3-72472be43006 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:34.318237 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4aed3b3c-66d1-4e1e-a9e3-72472be43006 None None] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:34.318988 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4aed3b3c-66d1-4e1e-a9e3-72472be43006 None None] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:34.319333 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4aed3b3c-66d1-4e1e-a9e3-72472be43006 None None] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:34.329511 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.compute.rpcapi [None req-4aed3b3c-66d1-4e1e-a9e3-72472be43006 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 19 16:32:34.330382 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4aed3b3c-66d1-4e1e-a9e3-72472be43006 None None] Releasing lock "compute-rpcapi-router" {{(pid=127285) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 19 16:32:34.350698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4aed3b3c-66d1-4e1e-a9e3-72472be43006 None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.083290 Aug 19 16:32:34.351311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 54/111] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:32:34.392298 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-4c359008-1d08-4563-b5e7-1315d8af699c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:34.394507 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-4c359008-1d08-4563-b5e7-1315d8af699c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:34.401836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4c359008-1d08-4563-b5e7-1315d8af699c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:34.402313 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4c359008-1d08-4563-b5e7-1315d8af699c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:34.403202 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4c359008-1d08-4563-b5e7-1315d8af699c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:34.404468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4c359008-1d08-4563-b5e7-1315d8af699c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:34.405353 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4c359008-1d08-4563-b5e7-1315d8af699c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:34.405922 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4c359008-1d08-4563-b5e7-1315d8af699c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:34.549253 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-4c359008-1d08-4563-b5e7-1315d8af699c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:34.557534 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-4c359008-1d08-4563-b5e7-1315d8af699c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1315 microversion: 2.1 time: 0.170052 Aug 19 16:32:34.558089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 58/112] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:34 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:35.065449 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e88dbde7-6421-4980-8c96-a2f16d63b1f8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:35.068473 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e88dbde7-6421-4980-8c96-a2f16d63b1f8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:35.082108 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e88dbde7-6421-4980-8c96-a2f16d63b1f8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:35.082647 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e88dbde7-6421-4980-8c96-a2f16d63b1f8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:35.083097 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e88dbde7-6421-4980-8c96-a2f16d63b1f8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:35.083849 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e88dbde7-6421-4980-8c96-a2f16d63b1f8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:35.084315 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e88dbde7-6421-4980-8c96-a2f16d63b1f8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:35.084736 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e88dbde7-6421-4980-8c96-a2f16d63b1f8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:35.099725 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-6fd80e0b-98ee-46bc-8cea-7b74e54195d3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:35.100462 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-6fd80e0b-98ee-46bc-8cea-7b74e54195d3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:35.109927 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6fd80e0b-98ee-46bc-8cea-7b74e54195d3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:35.110818 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6fd80e0b-98ee-46bc-8cea-7b74e54195d3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:35.111304 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6fd80e0b-98ee-46bc-8cea-7b74e54195d3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:35.112037 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6fd80e0b-98ee-46bc-8cea-7b74e54195d3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:35.112595 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6fd80e0b-98ee-46bc-8cea-7b74e54195d3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:35.113315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6fd80e0b-98ee-46bc-8cea-7b74e54195d3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:35.333895 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-6fd80e0b-98ee-46bc-8cea-7b74e54195d3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:35.341258 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e88dbde7-6421-4980-8c96-a2f16d63b1f8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:35.345831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-6fd80e0b-98ee-46bc-8cea-7b74e54195d3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1321 microversion: 2.1 time: 0.249760 Aug 19 16:32:35.347061 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 59/113] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:35 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:35.352631 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e88dbde7-6421-4980-8c96-a2f16d63b1f8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:35.355536 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e88dbde7-6421-4980-8c96-a2f16d63b1f8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:35.356665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e88dbde7-6421-4980-8c96-a2f16d63b1f8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1407 microversion: 2.20 time: 0.298234 Aug 19 16:32:35.370048 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 55/114] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:35 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:32:35.370048 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a9f351ef-33ed-4531-b880-d4cd439d9fb1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:35.370048 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a9f351ef-33ed-4531-b880-d4cd439d9fb1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:35.370048 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a9f351ef-33ed-4531-b880-d4cd439d9fb1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:35.370326 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a9f351ef-33ed-4531-b880-d4cd439d9fb1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:35.370401 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a9f351ef-33ed-4531-b880-d4cd439d9fb1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:35.371075 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a9f351ef-33ed-4531-b880-d4cd439d9fb1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:35.372381 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a9f351ef-33ed-4531-b880-d4cd439d9fb1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:35.373083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a9f351ef-33ed-4531-b880-d4cd439d9fb1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:35.379215 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-550d3c07-c73d-435d-80b1-822d3297d69c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:35.380054 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-550d3c07-c73d-435d-80b1-822d3297d69c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:35.411095 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-550d3c07-c73d-435d-80b1-822d3297d69c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:35.413300 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-550d3c07-c73d-435d-80b1-822d3297d69c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:35.413945 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-550d3c07-c73d-435d-80b1-822d3297d69c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:35.416525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-550d3c07-c73d-435d-80b1-822d3297d69c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:35.417227 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-550d3c07-c73d-435d-80b1-822d3297d69c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:35.417905 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-550d3c07-c73d-435d-80b1-822d3297d69c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:35.573876 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a9f351ef-33ed-4531-b880-d4cd439d9fb1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:35.580899 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-550d3c07-c73d-435d-80b1-822d3297d69c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:35.587298 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a9f351ef-33ed-4531-b880-d4cd439d9fb1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1364 microversion: 2.1 time: 0.228684 Aug 19 16:32:35.588841 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 56/115] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:35 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:35.604557 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-550d3c07-c73d-435d-80b1-822d3297d69c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 0.256166 Aug 19 16:32:35.605981 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 60/116] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:35 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:35.622915 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ab413062-7280-488e-a5dd-4826db7cbf99 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:35.623979 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ab413062-7280-488e-a5dd-4826db7cbf99 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:35.649354 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ab413062-7280-488e-a5dd-4826db7cbf99 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:35.649853 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ab413062-7280-488e-a5dd-4826db7cbf99 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:35.650837 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ab413062-7280-488e-a5dd-4826db7cbf99 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:35.658327 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ab413062-7280-488e-a5dd-4826db7cbf99 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:35.658327 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ab413062-7280-488e-a5dd-4826db7cbf99 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:35.658700 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ab413062-7280-488e-a5dd-4826db7cbf99 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:36.010707 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ab413062-7280-488e-a5dd-4826db7cbf99 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:36.019936 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ab413062-7280-488e-a5dd-4826db7cbf99 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1315 microversion: 2.1 time: 0.429893 Aug 19 16:32:36.020495 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 57/117] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:35 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:36.374599 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-3d40a75a-28a3-4b57-b495-a9beb229db74 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:36.375771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-3d40a75a-28a3-4b57-b495-a9beb229db74 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:36.379654 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ce1073d3-0c3e-4879-b5c3-f60d21b7ed16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:36.381053 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ce1073d3-0c3e-4879-b5c3-f60d21b7ed16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:36.382009 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3d40a75a-28a3-4b57-b495-a9beb229db74 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:36.382632 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3d40a75a-28a3-4b57-b495-a9beb229db74 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:36.383241 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3d40a75a-28a3-4b57-b495-a9beb229db74 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:36.384093 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3d40a75a-28a3-4b57-b495-a9beb229db74 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:36.385420 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3d40a75a-28a3-4b57-b495-a9beb229db74 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:36.386069 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3d40a75a-28a3-4b57-b495-a9beb229db74 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:36.388266 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce1073d3-0c3e-4879-b5c3-f60d21b7ed16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:36.389297 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce1073d3-0c3e-4879-b5c3-f60d21b7ed16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:36.389603 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce1073d3-0c3e-4879-b5c3-f60d21b7ed16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:36.390550 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce1073d3-0c3e-4879-b5c3-f60d21b7ed16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:36.391380 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce1073d3-0c3e-4879-b5c3-f60d21b7ed16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:36.392163 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce1073d3-0c3e-4879-b5c3-f60d21b7ed16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:36.803776 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ce1073d3-0c3e-4879-b5c3-f60d21b7ed16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:36.819101 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ce1073d3-0c3e-4879-b5c3-f60d21b7ed16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:36.824324 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ce1073d3-0c3e-4879-b5c3-f60d21b7ed16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:36.825499 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ce1073d3-0c3e-4879-b5c3-f60d21b7ed16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1407 microversion: 2.20 time: 0.449992 Aug 19 16:32:36.861902 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 58/118] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:36 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:32:36.874525 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-91966873-bc59-48f3-9ebd-15e351e8500d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:36.876826 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-91966873-bc59-48f3-9ebd-15e351e8500d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:36.888418 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-91966873-bc59-48f3-9ebd-15e351e8500d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:36.888986 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-91966873-bc59-48f3-9ebd-15e351e8500d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:36.889486 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-91966873-bc59-48f3-9ebd-15e351e8500d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:36.890232 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-91966873-bc59-48f3-9ebd-15e351e8500d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:36.891132 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-91966873-bc59-48f3-9ebd-15e351e8500d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:36.891827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-91966873-bc59-48f3-9ebd-15e351e8500d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:36.961288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-3d40a75a-28a3-4b57-b495-a9beb229db74 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:36.971061 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-3d40a75a-28a3-4b57-b495-a9beb229db74 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1321 microversion: 2.1 time: 0.600264 Aug 19 16:32:36.971992 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 61/119] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:36 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1321 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:36.992995 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2748b66a-dc60-4740-801d-e2a961830a46 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:36.994096 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2748b66a-dc60-4740-801d-e2a961830a46 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:37.000589 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2748b66a-dc60-4740-801d-e2a961830a46 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:37.001154 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2748b66a-dc60-4740-801d-e2a961830a46 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:37.001601 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2748b66a-dc60-4740-801d-e2a961830a46 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:37.002293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2748b66a-dc60-4740-801d-e2a961830a46 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:37.002735 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2748b66a-dc60-4740-801d-e2a961830a46 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:37.003440 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2748b66a-dc60-4740-801d-e2a961830a46 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:37.412163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2748b66a-dc60-4740-801d-e2a961830a46 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:37.428678 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-91966873-bc59-48f3-9ebd-15e351e8500d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:37.453064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-91966873-bc59-48f3-9ebd-15e351e8500d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1364 microversion: 2.1 time: 0.586189 Aug 19 16:32:37.454116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 59/120] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:36 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1364 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:37.486473 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2748b66a-dc60-4740-801d-e2a961830a46 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 0.510291 Aug 19 16:32:37.487126 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 62/121] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:36 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:37.499540 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6cfdb547-8552-46e3-976e-b6c93c5d266c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:37.500429 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6cfdb547-8552-46e3-976e-b6c93c5d266c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:37.507366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6cfdb547-8552-46e3-976e-b6c93c5d266c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:37.507894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6cfdb547-8552-46e3-976e-b6c93c5d266c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:37.508321 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6cfdb547-8552-46e3-976e-b6c93c5d266c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:37.510191 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6cfdb547-8552-46e3-976e-b6c93c5d266c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:37.510191 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6cfdb547-8552-46e3-976e-b6c93c5d266c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:37.510608 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6cfdb547-8552-46e3-976e-b6c93c5d266c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:37.850689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a47f8f69-210f-4ae1-ae5b-bfcb46803c2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:37.852318 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a47f8f69-210f-4ae1-ae5b-bfcb46803c2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:37.868623 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a47f8f69-210f-4ae1-ae5b-bfcb46803c2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:37.869429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a47f8f69-210f-4ae1-ae5b-bfcb46803c2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:37.870145 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a47f8f69-210f-4ae1-ae5b-bfcb46803c2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:37.871523 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a47f8f69-210f-4ae1-ae5b-bfcb46803c2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:37.872686 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a47f8f69-210f-4ae1-ae5b-bfcb46803c2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:37.873342 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a47f8f69-210f-4ae1-ae5b-bfcb46803c2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:38.096683 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a47f8f69-210f-4ae1-ae5b-bfcb46803c2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:38.106151 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a47f8f69-210f-4ae1-ae5b-bfcb46803c2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:38.107682 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a47f8f69-210f-4ae1-ae5b-bfcb46803c2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:38.109109 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a47f8f69-210f-4ae1-ae5b-bfcb46803c2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1407 microversion: 2.20 time: 0.263100 Aug 19 16:32:38.114525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 63/122] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:37 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:38.125330 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-bfce4901-e52e-4142-b7a1-39c71c175b0e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:38.127312 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-bfce4901-e52e-4142-b7a1-39c71c175b0e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:38.142994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bfce4901-e52e-4142-b7a1-39c71c175b0e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:38.145656 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bfce4901-e52e-4142-b7a1-39c71c175b0e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:38.146512 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bfce4901-e52e-4142-b7a1-39c71c175b0e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:38.149815 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bfce4901-e52e-4142-b7a1-39c71c175b0e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:38.151371 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bfce4901-e52e-4142-b7a1-39c71c175b0e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:38.151981 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bfce4901-e52e-4142-b7a1-39c71c175b0e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:38.204459 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=100 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:38.239977 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6cfdb547-8552-46e3-976e-b6c93c5d266c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:38.250214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6cfdb547-8552-46e3-976e-b6c93c5d266c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1315 microversion: 2.1 time: 0.792792 Aug 19 16:32:38.250962 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 60/123] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:37 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1315 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:38.401785 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-bfce4901-e52e-4142-b7a1-39c71c175b0e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:38.412794 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-bfce4901-e52e-4142-b7a1-39c71c175b0e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1321 microversion: 2.1 time: 0.296555 Aug 19 16:32:38.425714 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 64/124] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:38 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:38.476176 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4a695a51-4107-46e0-a168-39006b2f459b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:38.476938 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-4a695a51-4107-46e0-a168-39006b2f459b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:38.489089 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4a695a51-4107-46e0-a168-39006b2f459b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:38.489936 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4a695a51-4107-46e0-a168-39006b2f459b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:38.490049 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4a695a51-4107-46e0-a168-39006b2f459b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:38.490700 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4a695a51-4107-46e0-a168-39006b2f459b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:38.491424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4a695a51-4107-46e0-a168-39006b2f459b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:38.493906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4a695a51-4107-46e0-a168-39006b2f459b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:38.510406 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-51941654-af1f-49d9-81f9-f8457a9a24bd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:38.511457 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-51941654-af1f-49d9-81f9-f8457a9a24bd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:38.520943 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-51941654-af1f-49d9-81f9-f8457a9a24bd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:38.522743 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-51941654-af1f-49d9-81f9-f8457a9a24bd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:38.526293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-51941654-af1f-49d9-81f9-f8457a9a24bd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:38.527632 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-51941654-af1f-49d9-81f9-f8457a9a24bd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:38.529121 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-51941654-af1f-49d9-81f9-f8457a9a24bd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:38.529709 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-51941654-af1f-49d9-81f9-f8457a9a24bd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:38.768376 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-51941654-af1f-49d9-81f9-f8457a9a24bd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:38.774351 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-4a695a51-4107-46e0-a168-39006b2f459b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:38.777775 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-51941654-af1f-49d9-81f9-f8457a9a24bd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 0.273884 Aug 19 16:32:38.779365 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 65/125] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:38 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:38.783638 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4a695a51-4107-46e0-a168-39006b2f459b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1364 microversion: 2.1 time: 0.311915 Aug 19 16:32:38.784201 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 61/126] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:38 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1364 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:39.141538 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-08ab3198-2843-43e0-ae1a-aa398421ec8b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:39.142153 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-08ab3198-2843-43e0-ae1a-aa398421ec8b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:39.148052 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-08ab3198-2843-43e0-ae1a-aa398421ec8b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:39.148531 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-08ab3198-2843-43e0-ae1a-aa398421ec8b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:39.149210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-08ab3198-2843-43e0-ae1a-aa398421ec8b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:39.149905 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-08ab3198-2843-43e0-ae1a-aa398421ec8b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:39.151065 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-08ab3198-2843-43e0-ae1a-aa398421ec8b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:39.151468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-08ab3198-2843-43e0-ae1a-aa398421ec8b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:39.271290 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-97e78a58-f91c-4700-b05f-eabcb2dc7f0d tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:39.271893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-97e78a58-f91c-4700-b05f-eabcb2dc7f0d tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:39.278502 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-97e78a58-f91c-4700-b05f-eabcb2dc7f0d tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:39.278978 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-97e78a58-f91c-4700-b05f-eabcb2dc7f0d tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:39.279406 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-97e78a58-f91c-4700-b05f-eabcb2dc7f0d tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:39.280082 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-97e78a58-f91c-4700-b05f-eabcb2dc7f0d tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:39.280687 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-97e78a58-f91c-4700-b05f-eabcb2dc7f0d tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:39.281136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-97e78a58-f91c-4700-b05f-eabcb2dc7f0d tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:39.290384 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-08ab3198-2843-43e0-ae1a-aa398421ec8b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:39.298751 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-08ab3198-2843-43e0-ae1a-aa398421ec8b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:39.300604 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-08ab3198-2843-43e0-ae1a-aa398421ec8b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:39.301779 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-08ab3198-2843-43e0-ae1a-aa398421ec8b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1407 microversion: 2.20 time: 0.168576 Aug 19 16:32:39.302332 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 66/127] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:39 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:39.424450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-97e78a58-f91c-4700-b05f-eabcb2dc7f0d tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:39.432930 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-97e78a58-f91c-4700-b05f-eabcb2dc7f0d tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1315 microversion: 2.1 time: 0.165403 Aug 19 16:32:39.433602 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 62/128] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:39 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:39.445299 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2c8f7c1a-4ae7-4347-b8ff-066178bf826b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:39.446216 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2c8f7c1a-4ae7-4347-b8ff-066178bf826b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:39.453207 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2c8f7c1a-4ae7-4347-b8ff-066178bf826b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:39.453695 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2c8f7c1a-4ae7-4347-b8ff-066178bf826b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:39.454135 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2c8f7c1a-4ae7-4347-b8ff-066178bf826b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:39.454829 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2c8f7c1a-4ae7-4347-b8ff-066178bf826b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:39.455287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2c8f7c1a-4ae7-4347-b8ff-066178bf826b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:39.455713 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2c8f7c1a-4ae7-4347-b8ff-066178bf826b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:39.633623 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2c8f7c1a-4ae7-4347-b8ff-066178bf826b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:39.647459 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2c8f7c1a-4ae7-4347-b8ff-066178bf826b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1321 microversion: 2.1 time: 0.213844 Aug 19 16:32:39.648792 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 67/129] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:39 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:39.807279 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d2c68122-bdd0-4cd4-ac2c-f1f1a64b28ca tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:39.808139 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d2c68122-bdd0-4cd4-ac2c-f1f1a64b28ca tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:39.809209 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-561c5237-314c-48c4-b841-49a353fe9cc2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:39.812141 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-561c5237-314c-48c4-b841-49a353fe9cc2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:39.826483 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d2c68122-bdd0-4cd4-ac2c-f1f1a64b28ca tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:39.829333 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-561c5237-314c-48c4-b841-49a353fe9cc2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:39.830925 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d2c68122-bdd0-4cd4-ac2c-f1f1a64b28ca tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:39.833883 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d2c68122-bdd0-4cd4-ac2c-f1f1a64b28ca tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:39.834633 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-561c5237-314c-48c4-b841-49a353fe9cc2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:39.838765 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d2c68122-bdd0-4cd4-ac2c-f1f1a64b28ca tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:39.838765 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d2c68122-bdd0-4cd4-ac2c-f1f1a64b28ca tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:39.838955 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-561c5237-314c-48c4-b841-49a353fe9cc2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:39.839450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-561c5237-314c-48c4-b841-49a353fe9cc2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:39.839825 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d2c68122-bdd0-4cd4-ac2c-f1f1a64b28ca tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:39.843219 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-561c5237-314c-48c4-b841-49a353fe9cc2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:39.846250 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-561c5237-314c-48c4-b841-49a353fe9cc2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:40.098096 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-561c5237-314c-48c4-b841-49a353fe9cc2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:40.111744 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-561c5237-314c-48c4-b841-49a353fe9cc2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 0.315510 Aug 19 16:32:40.129100 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 63/130] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:39 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:40.249611 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d2c68122-bdd0-4cd4-ac2c-f1f1a64b28ca tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:40.257764 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d2c68122-bdd0-4cd4-ac2c-f1f1a64b28ca tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1364 microversion: 2.1 time: 0.456352 Aug 19 16:32:40.258350 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 68/131] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:39 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1364 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:40.330613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-5385e688-961c-400c-9d63-919632a60a74 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:40.331312 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-5385e688-961c-400c-9d63-919632a60a74 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:40.343404 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5385e688-961c-400c-9d63-919632a60a74 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:40.344607 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5385e688-961c-400c-9d63-919632a60a74 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:40.345142 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5385e688-961c-400c-9d63-919632a60a74 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:40.345922 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5385e688-961c-400c-9d63-919632a60a74 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:40.347223 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5385e688-961c-400c-9d63-919632a60a74 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:40.347754 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5385e688-961c-400c-9d63-919632a60a74 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:40.358892 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=100 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:40.455504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-52439569-e5a1-4e93-b7b0-c073e8ec186b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:40.466492 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-52439569-e5a1-4e93-b7b0-c073e8ec186b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:40.471684 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=100 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:40.485898 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-52439569-e5a1-4e93-b7b0-c073e8ec186b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:40.486403 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-52439569-e5a1-4e93-b7b0-c073e8ec186b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:40.487505 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-52439569-e5a1-4e93-b7b0-c073e8ec186b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:40.488239 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-52439569-e5a1-4e93-b7b0-c073e8ec186b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:40.488700 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-52439569-e5a1-4e93-b7b0-c073e8ec186b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:40.489864 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-52439569-e5a1-4e93-b7b0-c073e8ec186b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:40.796945 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5385e688-961c-400c-9d63-919632a60a74 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:40.814053 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5385e688-961c-400c-9d63-919632a60a74 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:40.817405 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5385e688-961c-400c-9d63-919632a60a74 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:40.818881 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-5385e688-961c-400c-9d63-919632a60a74 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1407 microversion: 2.20 time: 0.495258 Aug 19 16:32:40.819974 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 64/132] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:40 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:40.826570 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d4f85a26-7b4b-4f2f-b604-8ce985eae1ad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:40.827602 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d4f85a26-7b4b-4f2f-b604-8ce985eae1ad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:40.834411 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d4f85a26-7b4b-4f2f-b604-8ce985eae1ad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:40.836159 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d4f85a26-7b4b-4f2f-b604-8ce985eae1ad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:40.837764 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d4f85a26-7b4b-4f2f-b604-8ce985eae1ad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:40.838766 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d4f85a26-7b4b-4f2f-b604-8ce985eae1ad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:40.839470 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d4f85a26-7b4b-4f2f-b604-8ce985eae1ad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:40.840576 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d4f85a26-7b4b-4f2f-b604-8ce985eae1ad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:41.016926 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-52439569-e5a1-4e93-b7b0-c073e8ec186b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:41.027377 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-52439569-e5a1-4e93-b7b0-c073e8ec186b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1315 microversion: 2.1 time: 0.577070 Aug 19 16:32:41.028624 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d4f85a26-7b4b-4f2f-b604-8ce985eae1ad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:41.029094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 69/133] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:40 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:41.051190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d4f85a26-7b4b-4f2f-b604-8ce985eae1ad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1321 microversion: 2.1 time: 0.229768 Aug 19 16:32:41.052686 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 65/134] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:40 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:41.136259 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-0b3f1a61-5eb8-45e9-b6d9-b70bc23213df tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:41.137126 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-0b3f1a61-5eb8-45e9-b6d9-b70bc23213df tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:41.143256 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0b3f1a61-5eb8-45e9-b6d9-b70bc23213df tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:41.143761 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0b3f1a61-5eb8-45e9-b6d9-b70bc23213df tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:41.144188 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0b3f1a61-5eb8-45e9-b6d9-b70bc23213df tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:41.145398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0b3f1a61-5eb8-45e9-b6d9-b70bc23213df tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:41.146813 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0b3f1a61-5eb8-45e9-b6d9-b70bc23213df tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:41.147242 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0b3f1a61-5eb8-45e9-b6d9-b70bc23213df tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:41.278846 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3f0b98cf-3cf5-4083-a73e-4994c30c7c8a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:41.280025 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-3f0b98cf-3cf5-4083-a73e-4994c30c7c8a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:41.286515 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3f0b98cf-3cf5-4083-a73e-4994c30c7c8a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:41.286987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3f0b98cf-3cf5-4083-a73e-4994c30c7c8a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:41.287559 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3f0b98cf-3cf5-4083-a73e-4994c30c7c8a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:41.288380 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3f0b98cf-3cf5-4083-a73e-4994c30c7c8a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:41.288848 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3f0b98cf-3cf5-4083-a73e-4994c30c7c8a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:41.289411 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3f0b98cf-3cf5-4083-a73e-4994c30c7c8a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:41.454873 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-3f0b98cf-3cf5-4083-a73e-4994c30c7c8a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:41.465250 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3f0b98cf-3cf5-4083-a73e-4994c30c7c8a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1364 microversion: 2.1 time: 0.190649 Aug 19 16:32:41.468042 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 66/135] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:41 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1364 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:41.646290 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-0b3f1a61-5eb8-45e9-b6d9-b70bc23213df tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:41.656059 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-0b3f1a61-5eb8-45e9-b6d9-b70bc23213df tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 0.524296 Aug 19 16:32:41.656664 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 70/136] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:41 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:41.844161 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e191fcef-1d57-4fd8-b9a0-61610c3c4542 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:41.845000 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e191fcef-1d57-4fd8-b9a0-61610c3c4542 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:41.851149 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e191fcef-1d57-4fd8-b9a0-61610c3c4542 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:41.852491 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e191fcef-1d57-4fd8-b9a0-61610c3c4542 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:41.853834 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e191fcef-1d57-4fd8-b9a0-61610c3c4542 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:41.855224 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e191fcef-1d57-4fd8-b9a0-61610c3c4542 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:41.855737 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e191fcef-1d57-4fd8-b9a0-61610c3c4542 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:41.856342 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e191fcef-1d57-4fd8-b9a0-61610c3c4542 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:42.030181 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e191fcef-1d57-4fd8-b9a0-61610c3c4542 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:42.044854 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e191fcef-1d57-4fd8-b9a0-61610c3c4542 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:42.047196 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e191fcef-1d57-4fd8-b9a0-61610c3c4542 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:42.048906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e191fcef-1d57-4fd8-b9a0-61610c3c4542 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1407 microversion: 2.20 time: 0.208478 Aug 19 16:32:42.049891 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-52006837-e8e5-4293-b74a-9fe3ef27b8e9 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:42.050495 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-52006837-e8e5-4293-b74a-9fe3ef27b8e9 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:42.051479 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 67/137] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:41 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:42.052585 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=2 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:42.060552 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-52006837-e8e5-4293-b74a-9fe3ef27b8e9 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:42.061340 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-52006837-e8e5-4293-b74a-9fe3ef27b8e9 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:42.062004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-52006837-e8e5-4293-b74a-9fe3ef27b8e9 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:42.062986 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-52006837-e8e5-4293-b74a-9fe3ef27b8e9 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:42.063604 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-52006837-e8e5-4293-b74a-9fe3ef27b8e9 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:42.064178 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-52006837-e8e5-4293-b74a-9fe3ef27b8e9 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:42.075712 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c0658798-cf3f-4b9b-a4d0-f1420827577a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:42.076424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c0658798-cf3f-4b9b-a4d0-f1420827577a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:42.088802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c0658798-cf3f-4b9b-a4d0-f1420827577a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:42.094081 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c0658798-cf3f-4b9b-a4d0-f1420827577a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:42.094980 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c0658798-cf3f-4b9b-a4d0-f1420827577a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:42.097974 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c0658798-cf3f-4b9b-a4d0-f1420827577a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:42.099182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c0658798-cf3f-4b9b-a4d0-f1420827577a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:42.101019 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c0658798-cf3f-4b9b-a4d0-f1420827577a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:42.275946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c0658798-cf3f-4b9b-a4d0-f1420827577a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:42.286920 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c0658798-cf3f-4b9b-a4d0-f1420827577a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1321 microversion: 2.1 time: 0.215079 Aug 19 16:32:42.288103 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 68/138] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:42 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:42.320771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-52006837-e8e5-4293-b74a-9fe3ef27b8e9 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:42.333040 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-52006837-e8e5-4293-b74a-9fe3ef27b8e9 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1315 microversion: 2.1 time: 0.287910 Aug 19 16:32:42.333729 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 71/139] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:42 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:42.487830 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8944e73a-0271-4e45-856e-5f77e555d653 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:42.488542 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8944e73a-0271-4e45-856e-5f77e555d653 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:42.498544 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8944e73a-0271-4e45-856e-5f77e555d653 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:42.501175 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8944e73a-0271-4e45-856e-5f77e555d653 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:42.501722 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8944e73a-0271-4e45-856e-5f77e555d653 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:42.502663 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8944e73a-0271-4e45-856e-5f77e555d653 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:42.503339 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8944e73a-0271-4e45-856e-5f77e555d653 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:42.504844 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8944e73a-0271-4e45-856e-5f77e555d653 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:42.677881 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-5ab02ca9-12c1-4f94-b021-e784e2524238 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:42.678327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-5ab02ca9-12c1-4f94-b021-e784e2524238 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:42.691431 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5ab02ca9-12c1-4f94-b021-e784e2524238 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:42.693148 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5ab02ca9-12c1-4f94-b021-e784e2524238 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:42.694551 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5ab02ca9-12c1-4f94-b021-e784e2524238 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:42.696093 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5ab02ca9-12c1-4f94-b021-e784e2524238 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:42.697836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5ab02ca9-12c1-4f94-b021-e784e2524238 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:42.698475 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5ab02ca9-12c1-4f94-b021-e784e2524238 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:42.728362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-8944e73a-0271-4e45-856e-5f77e555d653 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:42.739465 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8944e73a-0271-4e45-856e-5f77e555d653 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1364 microversion: 2.1 time: 0.255461 Aug 19 16:32:42.740045 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 69/140] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:42 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1364 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:42.966143 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-5ab02ca9-12c1-4f94-b021-e784e2524238 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:42.980327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-5ab02ca9-12c1-4f94-b021-e784e2524238 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 0.306701 Aug 19 16:32:42.995065 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 72/141] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:42 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:43.077396 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8f037ebd-708e-4807-a864-4f16ebf41396 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:43.078110 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8f037ebd-708e-4807-a864-4f16ebf41396 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:43.098273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f037ebd-708e-4807-a864-4f16ebf41396 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:43.099073 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f037ebd-708e-4807-a864-4f16ebf41396 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:43.099732 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f037ebd-708e-4807-a864-4f16ebf41396 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:43.100774 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f037ebd-708e-4807-a864-4f16ebf41396 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:43.101242 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f037ebd-708e-4807-a864-4f16ebf41396 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:43.101691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f037ebd-708e-4807-a864-4f16ebf41396 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:43.262644 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-54cad055-f304-4364-bf80-2d7a4abdb530 req-3437a855-a98c-466f-8b68-045bf711634c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894cc1e2-8a17-4de0-8127-b929095837d8", "name": "network-vif-plugged", "status": "completed", "tag": "72e0a5f4-4545-47a6-8d9a-ae53acb35877"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:43.277991 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-54cad055-f304-4364-bf80-2d7a4abdb530 req-3437a855-a98c-466f-8b68-045bf711634c service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:43.278735 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-54cad055-f304-4364-bf80-2d7a4abdb530 req-3437a855-a98c-466f-8b68-045bf711634c service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:43.278898 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-54cad055-f304-4364-bf80-2d7a4abdb530 req-3437a855-a98c-466f-8b68-045bf711634c service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:43.284673 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8f037ebd-708e-4807-a864-4f16ebf41396 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:43.298573 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-54cad055-f304-4364-bf80-2d7a4abdb530 req-3437a855-a98c-466f-8b68-045bf711634c service nova] Creating event network-vif-plugged:72e0a5f4-4545-47a6-8d9a-ae53acb35877 for instance 894cc1e2-8a17-4de0-8127-b929095837d8 on hv-cinder-83124 Aug 19 16:32:43.301589 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8f037ebd-708e-4807-a864-4f16ebf41396 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:43.303692 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8f037ebd-708e-4807-a864-4f16ebf41396 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:43.305159 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8f037ebd-708e-4807-a864-4f16ebf41396 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1407 microversion: 2.20 time: 0.237165 Aug 19 16:32:43.308338 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 73/142] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:43 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:43.318275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-54cad055-f304-4364-bf80-2d7a4abdb530 req-3437a855-a98c-466f-8b68-045bf711634c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278167 Aug 19 16:32:43.319056 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 70/143] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:32:43.329819 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-11a2397c-8449-4cdd-bd68-c2b18e119393 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:43.330696 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-11a2397c-8449-4cdd-bd68-c2b18e119393 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:43.339628 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-11a2397c-8449-4cdd-bd68-c2b18e119393 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:43.340325 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-11a2397c-8449-4cdd-bd68-c2b18e119393 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:43.340995 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-11a2397c-8449-4cdd-bd68-c2b18e119393 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:43.342051 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-11a2397c-8449-4cdd-bd68-c2b18e119393 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:43.342844 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-11a2397c-8449-4cdd-bd68-c2b18e119393 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:43.343419 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-11a2397c-8449-4cdd-bd68-c2b18e119393 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:43.357995 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-76674955-b14a-4026-b6cf-00aec4320eba tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:43.358978 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-76674955-b14a-4026-b6cf-00aec4320eba tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:43.367271 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76674955-b14a-4026-b6cf-00aec4320eba tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:43.368133 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76674955-b14a-4026-b6cf-00aec4320eba tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:43.368831 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76674955-b14a-4026-b6cf-00aec4320eba tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:43.369744 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76674955-b14a-4026-b6cf-00aec4320eba tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:43.370390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76674955-b14a-4026-b6cf-00aec4320eba tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:43.371207 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76674955-b14a-4026-b6cf-00aec4320eba tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:43.572446 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-76674955-b14a-4026-b6cf-00aec4320eba tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:43.583211 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-76674955-b14a-4026-b6cf-00aec4320eba tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1315 microversion: 2.1 time: 0.228071 Aug 19 16:32:43.584875 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 71/144] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:43 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:43.689777 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-11a2397c-8449-4cdd-bd68-c2b18e119393 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:43.705193 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-11a2397c-8449-4cdd-bd68-c2b18e119393 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1321 microversion: 2.1 time: 0.380077 Aug 19 16:32:43.706401 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 74/145] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:43 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:43.767720 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-9465c279-aa63-4855-879b-a009878fbf31 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:43.768330 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-9465c279-aa63-4855-879b-a009878fbf31 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:43.781681 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9465c279-aa63-4855-879b-a009878fbf31 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:43.782470 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9465c279-aa63-4855-879b-a009878fbf31 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:43.783429 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9465c279-aa63-4855-879b-a009878fbf31 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:43.784338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9465c279-aa63-4855-879b-a009878fbf31 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:43.784968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9465c279-aa63-4855-879b-a009878fbf31 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:43.785663 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9465c279-aa63-4855-879b-a009878fbf31 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:43.848274 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-690f964a-457b-4756-aba4-da0e67d355e9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-69261930", "imageRef": "da4af7b7-e205-4511-ad99-3478c2523f74", "flavorRef": "452", "networks": [{"uuid": "3b8c4bd2-524b-4747-9fff-40ed56140f3c"}]}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:43.971120 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.network.neutron [None req-690f964a-457b-4756-aba4-da0e67d355e9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] validate_networks() for [('3b8c4bd2-524b-4747-9fff-40ed56140f3c', None, None, None, None, None)] {{(pid=127284) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:32:44.087109 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-9465c279-aa63-4855-879b-a009878fbf31 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:44.097139 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-9465c279-aa63-4855-879b-a009878fbf31 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1364 microversion: 2.1 time: 0.340097 Aug 19 16:32:44.097832 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 72/146] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:43 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1364 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:44.103557 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2bd95f5f-d29b-417b-b762-55cba1034390 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:44.104400 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2bd95f5f-d29b-417b-b762-55cba1034390 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:44.111333 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2bd95f5f-d29b-417b-b762-55cba1034390 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:44.112003 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2bd95f5f-d29b-417b-b762-55cba1034390 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:44.112815 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2bd95f5f-d29b-417b-b762-55cba1034390 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:44.113980 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2bd95f5f-d29b-417b-b762-55cba1034390 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:44.114632 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2bd95f5f-d29b-417b-b762-55cba1034390 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:44.115310 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2bd95f5f-d29b-417b-b762-55cba1034390 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:44.273526 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2bd95f5f-d29b-417b-b762-55cba1034390 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:44.281441 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2bd95f5f-d29b-417b-b762-55cba1034390 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 0.182244 Aug 19 16:32:44.282614 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 73/147] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:44 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:44.330582 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-9ec29a53-e717-48d5-95c3-85fc62be11ed tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:44.331461 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-9ec29a53-e717-48d5-95c3-85fc62be11ed tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:44.338990 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=2 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:44.341060 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9ec29a53-e717-48d5-95c3-85fc62be11ed tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:44.341807 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9ec29a53-e717-48d5-95c3-85fc62be11ed tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:44.342739 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9ec29a53-e717-48d5-95c3-85fc62be11ed tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:44.343696 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9ec29a53-e717-48d5-95c3-85fc62be11ed tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:44.344275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9ec29a53-e717-48d5-95c3-85fc62be11ed tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:44.344796 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9ec29a53-e717-48d5-95c3-85fc62be11ed tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:44.511587 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-690f964a-457b-4756-aba4-da0e67d355e9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Flavor limits 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:32:44.512504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-690f964a-457b-4756-aba4-da0e67d355e9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Image limits 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:32:44.513295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-690f964a-457b-4756-aba4-da0e67d355e9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Flavor pref 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:32:44.513904 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-690f964a-457b-4756-aba4-da0e67d355e9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Image pref 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:32:44.514035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-9ec29a53-e717-48d5-95c3-85fc62be11ed tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:44.514709 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-690f964a-457b-4756-aba4-da0e67d355e9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:32:44.523254 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-9ec29a53-e717-48d5-95c3-85fc62be11ed tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:44.525939 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-9ec29a53-e717-48d5-95c3-85fc62be11ed tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:44.527153 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-9ec29a53-e717-48d5-95c3-85fc62be11ed tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1407 microversion: 2.20 time: 0.200539 Aug 19 16:32:44.537567 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 74/148] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:44 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:32:44.539671 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-690f964a-457b-4756-aba4-da0e67d355e9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:44.540405 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-690f964a-457b-4756-aba4-da0e67d355e9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:44.541202 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-690f964a-457b-4756-aba4-da0e67d355e9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:44.542141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-690f964a-457b-4756-aba4-da0e67d355e9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:44.542819 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-690f964a-457b-4756-aba4-da0e67d355e9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:44.543458 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-690f964a-457b-4756-aba4-da0e67d355e9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:44.563927 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-690f964a-457b-4756-aba4-da0e67d355e9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Getting quotas for project a549f3d5fb9443409faa06cf7b00d8ca. Resources: {'ram', 'cores', 'instances'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:32:44.568279 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-690f964a-457b-4756-aba4-da0e67d355e9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Getting quotas for user 7536a92033384383bd625b6c969ebd38 and project a549f3d5fb9443409faa06cf7b00d8ca. Resources: {'ram', 'cores', 'instances'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:32:44.581056 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-690f964a-457b-4756-aba4-da0e67d355e9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Going to run 1 instances... {{(pid=127284) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:32:44.583664 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-690f964a-457b-4756-aba4-da0e67d355e9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='da4af7b7-e205-4511-ad99-3478c2523f74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:32:44.607620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-072f1832-bf88-4fc8-b28c-2ddce9a9b7b2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:44.608248 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-072f1832-bf88-4fc8-b28c-2ddce9a9b7b2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:44.612486 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=100 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:44.626720 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-072f1832-bf88-4fc8-b28c-2ddce9a9b7b2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:44.627252 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-072f1832-bf88-4fc8-b28c-2ddce9a9b7b2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:44.627706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-072f1832-bf88-4fc8-b28c-2ddce9a9b7b2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:44.629520 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-072f1832-bf88-4fc8-b28c-2ddce9a9b7b2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:44.633136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-072f1832-bf88-4fc8-b28c-2ddce9a9b7b2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:44.635373 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-072f1832-bf88-4fc8-b28c-2ddce9a9b7b2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:44.653530 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-690f964a-457b-4756-aba4-da0e67d355e9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.811170 Aug 19 16:32:44.654846 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 75/149] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Aug 19 16:32:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 19 16:32:44.674766 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-6f4bc690-d43f-435f-b96a-43e1401958db tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:44.675563 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-6f4bc690-d43f-435f-b96a-43e1401958db tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:44.784153 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-6f4bc690-d43f-435f-b96a-43e1401958db tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:44.792147 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-6f4bc690-d43f-435f-b96a-43e1401958db tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1212 microversion: 2.1 time: 0.127634 Aug 19 16:32:44.796683 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 76/150] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:44 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1212 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:44.809725 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c681df2d-f835-4420-8e52-7a9550694aad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:44.810603 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-c681df2d-f835-4420-8e52-7a9550694aad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:44.823668 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c681df2d-f835-4420-8e52-7a9550694aad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:44.824264 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c681df2d-f835-4420-8e52-7a9550694aad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:44.824583 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c681df2d-f835-4420-8e52-7a9550694aad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:44.825320 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c681df2d-f835-4420-8e52-7a9550694aad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:44.825773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c681df2d-f835-4420-8e52-7a9550694aad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:44.826199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c681df2d-f835-4420-8e52-7a9550694aad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:44.911117 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-072f1832-bf88-4fc8-b28c-2ddce9a9b7b2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:44.926344 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-072f1832-bf88-4fc8-b28c-2ddce9a9b7b2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1315 microversion: 2.1 time: 0.322724 Aug 19 16:32:44.927601 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 75/151] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:44 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:45.073598 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c681df2d-f835-4420-8e52-7a9550694aad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:45.095343 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c681df2d-f835-4420-8e52-7a9550694aad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1321 microversion: 2.1 time: 0.297483 Aug 19 16:32:45.095934 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 77/152] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:44 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:45.118428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0cb94505-1f43-49ff-a5d7-486349ca394b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:45.119594 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-0cb94505-1f43-49ff-a5d7-486349ca394b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:45.126827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0cb94505-1f43-49ff-a5d7-486349ca394b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:45.127308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0cb94505-1f43-49ff-a5d7-486349ca394b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:45.127731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0cb94505-1f43-49ff-a5d7-486349ca394b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:45.141546 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0cb94505-1f43-49ff-a5d7-486349ca394b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:45.141546 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0cb94505-1f43-49ff-a5d7-486349ca394b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:45.141546 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0cb94505-1f43-49ff-a5d7-486349ca394b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:45.301999 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-cf356533-12d4-4038-95b2-888de9abaa82 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:45.302623 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-cf356533-12d4-4038-95b2-888de9abaa82 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:45.309283 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cf356533-12d4-4038-95b2-888de9abaa82 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:45.309770 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cf356533-12d4-4038-95b2-888de9abaa82 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:45.310196 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cf356533-12d4-4038-95b2-888de9abaa82 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:45.313202 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cf356533-12d4-4038-95b2-888de9abaa82 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:45.315425 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cf356533-12d4-4038-95b2-888de9abaa82 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:45.317036 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cf356533-12d4-4038-95b2-888de9abaa82 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:45.408674 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-0cb94505-1f43-49ff-a5d7-486349ca394b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:45.430389 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-0cb94505-1f43-49ff-a5d7-486349ca394b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1364 microversion: 2.1 time: 0.315625 Aug 19 16:32:45.432554 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 76/153] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:45 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1364 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:45.446369 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-67904d0b-238a-48a6-9b4a-52ba1400aa9c req-eb427ef1-cd93-4380-9b3b-f050635a7391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fc9558-1f91-4cbd-b5f1-9342dc7d6148", "name": "network-vif-plugged", "status": "completed", "tag": "1a92f5a0-de60-40bf-b6d4-a7c9883868ba"}, {"server_uuid": "33d89321-9f57-4555-b081-9aacd51fba08", "name": "network-vif-plugged", "status": "completed", "tag": "c546c8c9-4520-43bf-97d3-35760918599b"}, {"server_uuid": "665dc524-b20c-4aa5-8861-13ad96d28939", "name": "network-vif-plugged", "status": "completed", "tag": "bb51172e-dc0e-4fcc-b012-110d88786f10"}, {"server_uuid": "9f1f3d4e-7c83-4d2b-a34f-4cac4b871285", "name": "network-vif-plugged", "status": "completed", "tag": "36d1a484-663f-4e9f-a220-92a99deec85f"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:45.487629 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-67904d0b-238a-48a6-9b4a-52ba1400aa9c req-eb427ef1-cd93-4380-9b3b-f050635a7391 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:45.488192 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-67904d0b-238a-48a6-9b4a-52ba1400aa9c req-eb427ef1-cd93-4380-9b3b-f050635a7391 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:45.489268 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-67904d0b-238a-48a6-9b4a-52ba1400aa9c req-eb427ef1-cd93-4380-9b3b-f050635a7391 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:45.529423 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-67904d0b-238a-48a6-9b4a-52ba1400aa9c req-eb427ef1-cd93-4380-9b3b-f050635a7391 service nova] Creating event network-vif-plugged:1a92f5a0-de60-40bf-b6d4-a7c9883868ba for instance 73fc9558-1f91-4cbd-b5f1-9342dc7d6148 on hv-cinder-83124 Aug 19 16:32:45.532811 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-cf356533-12d4-4038-95b2-888de9abaa82 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:45.533349 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-67904d0b-238a-48a6-9b4a-52ba1400aa9c req-eb427ef1-cd93-4380-9b3b-f050635a7391 service nova] Creating event network-vif-plugged:c546c8c9-4520-43bf-97d3-35760918599b for instance 33d89321-9f57-4555-b081-9aacd51fba08 on hv-cinder-83124 Aug 19 16:32:45.534421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-67904d0b-238a-48a6-9b4a-52ba1400aa9c req-eb427ef1-cd93-4380-9b3b-f050635a7391 service nova] Creating event network-vif-plugged:bb51172e-dc0e-4fcc-b012-110d88786f10 for instance 665dc524-b20c-4aa5-8861-13ad96d28939 on hv-cinder-83124 Aug 19 16:32:45.535779 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-67904d0b-238a-48a6-9b4a-52ba1400aa9c req-eb427ef1-cd93-4380-9b3b-f050635a7391 service nova] Creating event network-vif-plugged:36d1a484-663f-4e9f-a220-92a99deec85f for instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 on hv-cinder-83124 Aug 19 16:32:45.542940 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-cf356533-12d4-4038-95b2-888de9abaa82 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 0.244647 Aug 19 16:32:45.543937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 78/154] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:45 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:45.551872 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-30ecef41-1ee4-4ea4-a0ca-92dbe61edab2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:45.552682 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-30ecef41-1ee4-4ea4-a0ca-92dbe61edab2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:45.559748 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-30ecef41-1ee4-4ea4-a0ca-92dbe61edab2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:45.560422 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-30ecef41-1ee4-4ea4-a0ca-92dbe61edab2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:45.561028 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-30ecef41-1ee4-4ea4-a0ca-92dbe61edab2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:45.561865 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-30ecef41-1ee4-4ea4-a0ca-92dbe61edab2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:45.562342 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-30ecef41-1ee4-4ea4-a0ca-92dbe61edab2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:45.568289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-30ecef41-1ee4-4ea4-a0ca-92dbe61edab2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:45.568703 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-67904d0b-238a-48a6-9b4a-52ba1400aa9c req-eb427ef1-cd93-4380-9b3b-f050635a7391 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.132608 Aug 19 16:32:45.569777 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 77/155] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:32:45.728639 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-30ecef41-1ee4-4ea4-a0ca-92dbe61edab2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:45.736816 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-30ecef41-1ee4-4ea4-a0ca-92dbe61edab2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:45.738301 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-30ecef41-1ee4-4ea4-a0ca-92dbe61edab2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:45.739396 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-30ecef41-1ee4-4ea4-a0ca-92dbe61edab2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1407 microversion: 2.20 time: 0.191625 Aug 19 16:32:45.753150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 79/156] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:45 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:32:45.813416 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-08ed9b65-eeb9-4589-abe7-56b7c940bb2c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:45.814108 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-08ed9b65-eeb9-4589-abe7-56b7c940bb2c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:45.820796 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-08ed9b65-eeb9-4589-abe7-56b7c940bb2c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:45.821490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-08ed9b65-eeb9-4589-abe7-56b7c940bb2c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:45.822162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-08ed9b65-eeb9-4589-abe7-56b7c940bb2c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:45.823101 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-08ed9b65-eeb9-4589-abe7-56b7c940bb2c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:45.824046 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-08ed9b65-eeb9-4589-abe7-56b7c940bb2c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:45.824991 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-08ed9b65-eeb9-4589-abe7-56b7c940bb2c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:45.916207 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-08ed9b65-eeb9-4589-abe7-56b7c940bb2c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:45.927503 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-08ed9b65-eeb9-4589-abe7-56b7c940bb2c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1208 microversion: 2.1 time: 0.118459 Aug 19 16:32:45.928997 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 78/157] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:45 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1208 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:45.949473 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a0481bf3-b229-47e6-9f72-8df9b3998a56 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:45.951072 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a0481bf3-b229-47e6-9f72-8df9b3998a56 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:45.960289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a0481bf3-b229-47e6-9f72-8df9b3998a56 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:45.961130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a0481bf3-b229-47e6-9f72-8df9b3998a56 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:45.963570 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a0481bf3-b229-47e6-9f72-8df9b3998a56 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:45.964522 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a0481bf3-b229-47e6-9f72-8df9b3998a56 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:45.965721 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a0481bf3-b229-47e6-9f72-8df9b3998a56 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:45.966283 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a0481bf3-b229-47e6-9f72-8df9b3998a56 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:46.118939 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-81d2beb6-a062-4d74-973b-2f16de77b3d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:46.120107 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-81d2beb6-a062-4d74-973b-2f16de77b3d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:46.127764 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-81d2beb6-a062-4d74-973b-2f16de77b3d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:46.128823 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-81d2beb6-a062-4d74-973b-2f16de77b3d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:46.129462 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-81d2beb6-a062-4d74-973b-2f16de77b3d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:46.130486 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-81d2beb6-a062-4d74-973b-2f16de77b3d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:46.131558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-81d2beb6-a062-4d74-973b-2f16de77b3d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:46.132281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-81d2beb6-a062-4d74-973b-2f16de77b3d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:46.144209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a0481bf3-b229-47e6-9f72-8df9b3998a56 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:46.153025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a0481bf3-b229-47e6-9f72-8df9b3998a56 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1315 microversion: 2.1 time: 0.208977 Aug 19 16:32:46.161836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 80/158] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:45 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:46.292042 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-81d2beb6-a062-4d74-973b-2f16de77b3d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:46.301807 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-81d2beb6-a062-4d74-973b-2f16de77b3d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1321 microversion: 2.1 time: 0.188336 Aug 19 16:32:46.302604 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 79/159] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:46 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:46.456950 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-0b7542a9-08cf-430b-8426-1b91def10dff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:46.457886 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-0b7542a9-08cf-430b-8426-1b91def10dff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:46.467269 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0b7542a9-08cf-430b-8426-1b91def10dff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:46.468499 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0b7542a9-08cf-430b-8426-1b91def10dff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:46.469068 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0b7542a9-08cf-430b-8426-1b91def10dff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:46.469846 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0b7542a9-08cf-430b-8426-1b91def10dff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:46.470503 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0b7542a9-08cf-430b-8426-1b91def10dff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:46.470946 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0b7542a9-08cf-430b-8426-1b91def10dff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:46.570618 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-9f229176-e504-4d53-945e-0eb6eb775053 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:46.571300 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-9f229176-e504-4d53-945e-0eb6eb775053 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:46.585643 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f229176-e504-4d53-945e-0eb6eb775053 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:46.597872 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f229176-e504-4d53-945e-0eb6eb775053 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:46.598459 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f229176-e504-4d53-945e-0eb6eb775053 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:46.599379 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f229176-e504-4d53-945e-0eb6eb775053 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:46.601294 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f229176-e504-4d53-945e-0eb6eb775053 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:46.602149 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f229176-e504-4d53-945e-0eb6eb775053 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:46.743070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-0b7542a9-08cf-430b-8426-1b91def10dff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:46.754466 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-0b7542a9-08cf-430b-8426-1b91def10dff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1364 microversion: 2.1 time: 0.305449 Aug 19 16:32:46.757106 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 81/160] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:46 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1364 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:46.771858 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b8e541fd-8dde-49f2-a55f-eaf216d2ba14 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:46.773285 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-b8e541fd-8dde-49f2-a55f-eaf216d2ba14 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:46.793765 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b8e541fd-8dde-49f2-a55f-eaf216d2ba14 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:46.798625 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b8e541fd-8dde-49f2-a55f-eaf216d2ba14 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:46.800110 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b8e541fd-8dde-49f2-a55f-eaf216d2ba14 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:46.801380 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b8e541fd-8dde-49f2-a55f-eaf216d2ba14 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:46.804175 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b8e541fd-8dde-49f2-a55f-eaf216d2ba14 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:46.806476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b8e541fd-8dde-49f2-a55f-eaf216d2ba14 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:46.920204 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-9f229176-e504-4d53-945e-0eb6eb775053 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:46.928268 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-9f229176-e504-4d53-945e-0eb6eb775053 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 0.367022 Aug 19 16:32:46.929152 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 80/161] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:46 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:46.949720 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-aa54d0fe-58df-474c-a8f3-0201491a70cd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:46.950340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-aa54d0fe-58df-474c-a8f3-0201491a70cd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:46.956291 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-aa54d0fe-58df-474c-a8f3-0201491a70cd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:46.957054 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-aa54d0fe-58df-474c-a8f3-0201491a70cd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:46.957635 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-aa54d0fe-58df-474c-a8f3-0201491a70cd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:46.958572 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-aa54d0fe-58df-474c-a8f3-0201491a70cd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:46.959161 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-aa54d0fe-58df-474c-a8f3-0201491a70cd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:46.960726 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-aa54d0fe-58df-474c-a8f3-0201491a70cd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:47.045960 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-aa54d0fe-58df-474c-a8f3-0201491a70cd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:47.054618 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-aa54d0fe-58df-474c-a8f3-0201491a70cd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1264 microversion: 2.1 time: 0.109616 Aug 19 16:32:47.055410 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 81/162] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:46 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1264 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:47.055532 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b8e541fd-8dde-49f2-a55f-eaf216d2ba14 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:47.059576 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=100 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:47.065898 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b8e541fd-8dde-49f2-a55f-eaf216d2ba14 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:47.067440 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b8e541fd-8dde-49f2-a55f-eaf216d2ba14 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:47.068589 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b8e541fd-8dde-49f2-a55f-eaf216d2ba14 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1599 microversion: 2.20 time: 0.304698 Aug 19 16:32:47.069190 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 82/163] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:32:46 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1599 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:32:47.093755 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-afe26381-80a7-4951-8b3a-e2b1967415ff tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:47.094940 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-afe26381-80a7-4951-8b3a-e2b1967415ff tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:47.102327 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-afe26381-80a7-4951-8b3a-e2b1967415ff tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:47.103107 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-afe26381-80a7-4951-8b3a-e2b1967415ff tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:47.103759 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-afe26381-80a7-4951-8b3a-e2b1967415ff tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:47.104539 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-afe26381-80a7-4951-8b3a-e2b1967415ff tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:47.105125 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-afe26381-80a7-4951-8b3a-e2b1967415ff tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:47.105555 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-afe26381-80a7-4951-8b3a-e2b1967415ff tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:47.137331 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=100 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:47.176868 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a0576974-6ceb-42d0-be1f-cb980b2cb335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:47.177863 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a0576974-6ceb-42d0-be1f-cb980b2cb335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:47.188632 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a0576974-6ceb-42d0-be1f-cb980b2cb335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:47.193316 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a0576974-6ceb-42d0-be1f-cb980b2cb335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:47.193853 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a0576974-6ceb-42d0-be1f-cb980b2cb335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:47.194576 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a0576974-6ceb-42d0-be1f-cb980b2cb335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:47.195091 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a0576974-6ceb-42d0-be1f-cb980b2cb335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:47.195520 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a0576974-6ceb-42d0-be1f-cb980b2cb335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:47.363424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-afe26381-80a7-4951-8b3a-e2b1967415ff tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.274399 Aug 19 16:32:47.364583 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 82/164] 10.222.0.55 () {60 vars in 1316 bytes} [Fri Aug 19 16:32:47 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8/os-interface => generated 285 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:32:47.370938 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-9a307f6b-59aa-43db-82ac-bd6a8db4cf92 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:47.371867 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-9a307f6b-59aa-43db-82ac-bd6a8db4cf92 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:47.378119 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9a307f6b-59aa-43db-82ac-bd6a8db4cf92 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:47.379719 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9a307f6b-59aa-43db-82ac-bd6a8db4cf92 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:47.380376 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9a307f6b-59aa-43db-82ac-bd6a8db4cf92 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:47.381102 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a0576974-6ceb-42d0-be1f-cb980b2cb335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:47.381493 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9a307f6b-59aa-43db-82ac-bd6a8db4cf92 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:47.382476 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9a307f6b-59aa-43db-82ac-bd6a8db4cf92 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:47.383005 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9a307f6b-59aa-43db-82ac-bd6a8db4cf92 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:47.390146 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a0576974-6ceb-42d0-be1f-cb980b2cb335 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1315 microversion: 2.1 time: 0.218040 Aug 19 16:32:47.403507 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 83/165] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:47 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:47.590899 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-2fc45f7d-9f06-48d6-8abc-58ca495f714f req-adc4676c-7dde-4bca-ab0a-024c463d8046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1eddf01-3fc7-4c5c-8560-96cddb34a199", "name": "network-vif-plugged", "status": "completed", "tag": "f7152602-0c68-468a-8871-72cc6f1ab0dc"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:47.602262 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-2fc45f7d-9f06-48d6-8abc-58ca495f714f req-adc4676c-7dde-4bca-ab0a-024c463d8046 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:47.602934 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-2fc45f7d-9f06-48d6-8abc-58ca495f714f req-adc4676c-7dde-4bca-ab0a-024c463d8046 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:47.603866 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-2fc45f7d-9f06-48d6-8abc-58ca495f714f req-adc4676c-7dde-4bca-ab0a-024c463d8046 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:47.616853 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-2fc45f7d-9f06-48d6-8abc-58ca495f714f req-adc4676c-7dde-4bca-ab0a-024c463d8046 service nova] Creating event network-vif-plugged:f7152602-0c68-468a-8871-72cc6f1ab0dc for instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 on hv-cinder-83124 Aug 19 16:32:47.623006 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-2fc45f7d-9f06-48d6-8abc-58ca495f714f req-adc4676c-7dde-4bca-ab0a-024c463d8046 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038367 Aug 19 16:32:47.623663 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 84/166] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:32:47.778455 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c02a5505-8cd5-448c-b694-e7401e72831f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:47.779354 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-c02a5505-8cd5-448c-b694-e7401e72831f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:47.785619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c02a5505-8cd5-448c-b694-e7401e72831f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:47.786351 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c02a5505-8cd5-448c-b694-e7401e72831f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:47.787005 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c02a5505-8cd5-448c-b694-e7401e72831f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:47.788257 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c02a5505-8cd5-448c-b694-e7401e72831f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:47.788941 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c02a5505-8cd5-448c-b694-e7401e72831f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:47.800443 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c02a5505-8cd5-448c-b694-e7401e72831f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:47.991806 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c02a5505-8cd5-448c-b694-e7401e72831f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:48.003887 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c02a5505-8cd5-448c-b694-e7401e72831f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1364 microversion: 2.1 time: 0.227736 Aug 19 16:32:48.004989 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 85/167] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:47 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:48.011538 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-bc94a598-e14f-4909-a3f5-df2e74c3d169 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:48.012596 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-bc94a598-e14f-4909-a3f5-df2e74c3d169 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:48.021981 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bc94a598-e14f-4909-a3f5-df2e74c3d169 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:48.022907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bc94a598-e14f-4909-a3f5-df2e74c3d169 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:48.023525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bc94a598-e14f-4909-a3f5-df2e74c3d169 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:48.024652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bc94a598-e14f-4909-a3f5-df2e74c3d169 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:48.025483 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bc94a598-e14f-4909-a3f5-df2e74c3d169 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:48.026135 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bc94a598-e14f-4909-a3f5-df2e74c3d169 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:48.104517 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-9a307f6b-59aa-43db-82ac-bd6a8db4cf92 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:48.112175 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-9a307f6b-59aa-43db-82ac-bd6a8db4cf92 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1321 microversion: 2.1 time: 0.746447 Aug 19 16:32:48.112942 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 83/168] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:47 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1321 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:48.129882 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-52b16024-663a-4ad3-acf9-fd67b2da7b2e tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:48.130789 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-52b16024-663a-4ad3-acf9-fd67b2da7b2e tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:48.139007 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-52b16024-663a-4ad3-acf9-fd67b2da7b2e tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:48.139819 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-52b16024-663a-4ad3-acf9-fd67b2da7b2e tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:48.140223 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-52b16024-663a-4ad3-acf9-fd67b2da7b2e tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:48.141093 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-52b16024-663a-4ad3-acf9-fd67b2da7b2e tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:48.141602 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-52b16024-663a-4ad3-acf9-fd67b2da7b2e tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:48.142011 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-52b16024-663a-4ad3-acf9-fd67b2da7b2e tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:48.195508 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-bc94a598-e14f-4909-a3f5-df2e74c3d169 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:48.204778 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-bc94a598-e14f-4909-a3f5-df2e74c3d169 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 0.198411 Aug 19 16:32:48.205508 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 86/169] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:48 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:48.222689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-52b16024-663a-4ad3-acf9-fd67b2da7b2e tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:48.233524 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-52b16024-663a-4ad3-acf9-fd67b2da7b2e tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1270 microversion: 2.1 time: 0.119439 Aug 19 16:32:48.234626 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 84/170] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:48 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1270 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:48.411692 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-3ab74c35-e00e-4253-a99e-86b0f645fd2c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:48.412305 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-3ab74c35-e00e-4253-a99e-86b0f645fd2c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:48.420312 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3ab74c35-e00e-4253-a99e-86b0f645fd2c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:48.421000 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3ab74c35-e00e-4253-a99e-86b0f645fd2c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:48.421463 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3ab74c35-e00e-4253-a99e-86b0f645fd2c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:48.422151 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3ab74c35-e00e-4253-a99e-86b0f645fd2c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:48.422595 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3ab74c35-e00e-4253-a99e-86b0f645fd2c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:48.423009 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3ab74c35-e00e-4253-a99e-86b0f645fd2c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:48.574744 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-3ab74c35-e00e-4253-a99e-86b0f645fd2c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:48.585673 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-3ab74c35-e00e-4253-a99e-86b0f645fd2c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1315 microversion: 2.1 time: 0.178643 Aug 19 16:32:48.586473 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 87/171] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:48 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:49.026128 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e95da1af-7aaf-4a8d-b2f6-483c1f76db3f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:49.026658 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e95da1af-7aaf-4a8d-b2f6-483c1f76db3f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:49.032778 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e95da1af-7aaf-4a8d-b2f6-483c1f76db3f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:49.033284 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e95da1af-7aaf-4a8d-b2f6-483c1f76db3f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:49.033719 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e95da1af-7aaf-4a8d-b2f6-483c1f76db3f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:49.034413 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e95da1af-7aaf-4a8d-b2f6-483c1f76db3f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:49.034874 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e95da1af-7aaf-4a8d-b2f6-483c1f76db3f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:49.035297 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e95da1af-7aaf-4a8d-b2f6-483c1f76db3f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:49.126484 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-be81125d-8410-4483-a35c-b27c6cc88f95 req-4e60b106-fd53-4efd-b242-074fb124521f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "894cc1e2-8a17-4de0-8127-b929095837d8", "tag": "72e0a5f4-4545-47a6-8d9a-ae53acb35877"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:49.142252 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-be81125d-8410-4483-a35c-b27c6cc88f95 req-4e60b106-fd53-4efd-b242-074fb124521f service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:49.142952 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-be81125d-8410-4483-a35c-b27c6cc88f95 req-4e60b106-fd53-4efd-b242-074fb124521f service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:49.143624 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-be81125d-8410-4483-a35c-b27c6cc88f95 req-4e60b106-fd53-4efd-b242-074fb124521f service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:49.160216 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-be81125d-8410-4483-a35c-b27c6cc88f95 req-4e60b106-fd53-4efd-b242-074fb124521f service nova] Creating event network-changed:72e0a5f4-4545-47a6-8d9a-ae53acb35877 for instance 894cc1e2-8a17-4de0-8127-b929095837d8 on hv-cinder-83124 Aug 19 16:32:49.168976 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-be81125d-8410-4483-a35c-b27c6cc88f95 req-4e60b106-fd53-4efd-b242-074fb124521f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046072 Aug 19 16:32:49.170909 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 88/172] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:32:49.177240 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-96b9973e-da14-4718-8dfe-6360fcbca738 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:49.179329 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-96b9973e-da14-4718-8dfe-6360fcbca738 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:49.186752 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-96b9973e-da14-4718-8dfe-6360fcbca738 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:49.187565 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-96b9973e-da14-4718-8dfe-6360fcbca738 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:49.188403 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-96b9973e-da14-4718-8dfe-6360fcbca738 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:49.189309 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-96b9973e-da14-4718-8dfe-6360fcbca738 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:49.189899 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-96b9973e-da14-4718-8dfe-6360fcbca738 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:49.190635 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-96b9973e-da14-4718-8dfe-6360fcbca738 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:49.214008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e95da1af-7aaf-4a8d-b2f6-483c1f76db3f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:49.222472 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e95da1af-7aaf-4a8d-b2f6-483c1f76db3f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1364 microversion: 2.1 time: 0.201015 Aug 19 16:32:49.223043 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 85/173] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:49 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:49.228792 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6f806336-fc80-47b7-886b-6ffa11d7fb20 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:49.229702 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6f806336-fc80-47b7-886b-6ffa11d7fb20 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:49.235947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6f806336-fc80-47b7-886b-6ffa11d7fb20 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:49.237744 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6f806336-fc80-47b7-886b-6ffa11d7fb20 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:49.238370 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6f806336-fc80-47b7-886b-6ffa11d7fb20 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:49.239278 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6f806336-fc80-47b7-886b-6ffa11d7fb20 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:49.239884 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6f806336-fc80-47b7-886b-6ffa11d7fb20 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:49.240471 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6f806336-fc80-47b7-886b-6ffa11d7fb20 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:49.362164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-96b9973e-da14-4718-8dfe-6360fcbca738 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:49.372522 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-96b9973e-da14-4718-8dfe-6360fcbca738 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1321 microversion: 2.1 time: 0.200279 Aug 19 16:32:49.374116 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 89/174] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:49 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:49.379934 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-4d0568dc-3b7c-474a-ad49-96081da70c62 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:49.380698 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-4d0568dc-3b7c-474a-ad49-96081da70c62 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:49.391317 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4d0568dc-3b7c-474a-ad49-96081da70c62 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:49.392047 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4d0568dc-3b7c-474a-ad49-96081da70c62 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:49.392807 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4d0568dc-3b7c-474a-ad49-96081da70c62 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:49.393776 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4d0568dc-3b7c-474a-ad49-96081da70c62 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:49.394475 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4d0568dc-3b7c-474a-ad49-96081da70c62 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:49.395100 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4d0568dc-3b7c-474a-ad49-96081da70c62 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:49.404888 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6f806336-fc80-47b7-886b-6ffa11d7fb20 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:49.412963 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6f806336-fc80-47b7-886b-6ffa11d7fb20 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 0.188622 Aug 19 16:32:49.427767 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 86/175] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:49 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:49.467444 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-4d0568dc-3b7c-474a-ad49-96081da70c62 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:49.476113 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-4d0568dc-3b7c-474a-ad49-96081da70c62 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1270 microversion: 2.1 time: 0.100478 Aug 19 16:32:49.476922 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 90/176] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:49 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:49.607544 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-249671c6-7560-4e54-a14e-c28c131a6c9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:49.608403 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-249671c6-7560-4e54-a14e-c28c131a6c9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:49.615696 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-249671c6-7560-4e54-a14e-c28c131a6c9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:49.616338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-249671c6-7560-4e54-a14e-c28c131a6c9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:49.616986 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-249671c6-7560-4e54-a14e-c28c131a6c9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:49.617828 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-249671c6-7560-4e54-a14e-c28c131a6c9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:49.618995 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-249671c6-7560-4e54-a14e-c28c131a6c9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:49.619566 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-249671c6-7560-4e54-a14e-c28c131a6c9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:49.760696 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-249671c6-7560-4e54-a14e-c28c131a6c9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:49.768383 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-249671c6-7560-4e54-a14e-c28c131a6c9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1315 microversion: 2.1 time: 0.164729 Aug 19 16:32:49.769062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 87/177] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:49 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:50.244015 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-669b5eb8-9876-454e-abc4-61d5caf0b61e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:50.244723 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-669b5eb8-9876-454e-abc4-61d5caf0b61e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:50.251291 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-669b5eb8-9876-454e-abc4-61d5caf0b61e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:50.251774 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-669b5eb8-9876-454e-abc4-61d5caf0b61e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:50.252207 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-669b5eb8-9876-454e-abc4-61d5caf0b61e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:50.252933 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-669b5eb8-9876-454e-abc4-61d5caf0b61e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:50.253383 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-669b5eb8-9876-454e-abc4-61d5caf0b61e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:50.253797 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-669b5eb8-9876-454e-abc4-61d5caf0b61e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:50.391504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-669b5eb8-9876-454e-abc4-61d5caf0b61e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:50.393963 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e1c4736c-b11a-4d99-b59e-5536f7753bb2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:50.394575 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e1c4736c-b11a-4d99-b59e-5536f7753bb2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:50.399270 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-669b5eb8-9876-454e-abc4-61d5caf0b61e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1364 microversion: 2.1 time: 0.159421 Aug 19 16:32:50.400511 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 91/178] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:50 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:50.410921 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e1c4736c-b11a-4d99-b59e-5536f7753bb2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:50.411686 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e1c4736c-b11a-4d99-b59e-5536f7753bb2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:50.412234 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e1c4736c-b11a-4d99-b59e-5536f7753bb2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:50.413088 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e1c4736c-b11a-4d99-b59e-5536f7753bb2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:50.413529 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e1c4736c-b11a-4d99-b59e-5536f7753bb2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:50.413944 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e1c4736c-b11a-4d99-b59e-5536f7753bb2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:50.434464 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-9fe8a250-8a5e-4a18-8081-560245584bf5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:50.435067 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-9fe8a250-8a5e-4a18-8081-560245584bf5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:50.450565 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9fe8a250-8a5e-4a18-8081-560245584bf5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:50.451050 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9fe8a250-8a5e-4a18-8081-560245584bf5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:50.451747 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9fe8a250-8a5e-4a18-8081-560245584bf5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:50.452439 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9fe8a250-8a5e-4a18-8081-560245584bf5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:50.452969 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9fe8a250-8a5e-4a18-8081-560245584bf5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:50.454198 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9fe8a250-8a5e-4a18-8081-560245584bf5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:50.550306 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e1c4736c-b11a-4d99-b59e-5536f7753bb2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:50.562255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e1c4736c-b11a-4d99-b59e-5536f7753bb2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1321 microversion: 2.1 time: 0.171956 Aug 19 16:32:50.562838 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 88/179] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:50 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:50.574075 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b79d7f58-5ad4-423d-a968-93d3d21e108b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:50.574470 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b79d7f58-5ad4-423d-a968-93d3d21e108b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:50.580669 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b79d7f58-5ad4-423d-a968-93d3d21e108b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:50.581214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b79d7f58-5ad4-423d-a968-93d3d21e108b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:50.581642 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b79d7f58-5ad4-423d-a968-93d3d21e108b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:50.582334 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b79d7f58-5ad4-423d-a968-93d3d21e108b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:50.582783 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b79d7f58-5ad4-423d-a968-93d3d21e108b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:50.583199 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b79d7f58-5ad4-423d-a968-93d3d21e108b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:50.610317 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-9fe8a250-8a5e-4a18-8081-560245584bf5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:50.618904 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-9fe8a250-8a5e-4a18-8081-560245584bf5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 0.187514 Aug 19 16:32:50.619934 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 92/180] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:50 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:50.646499 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b79d7f58-5ad4-423d-a968-93d3d21e108b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:50.655068 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b79d7f58-5ad4-423d-a968-93d3d21e108b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1270 microversion: 2.1 time: 0.091194 Aug 19 16:32:50.655954 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 89/181] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:50 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:50.789938 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2f05d907-3202-4af4-9553-095d8f1d2d04 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:50.790567 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2f05d907-3202-4af4-9553-095d8f1d2d04 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:50.796575 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2f05d907-3202-4af4-9553-095d8f1d2d04 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:50.797088 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2f05d907-3202-4af4-9553-095d8f1d2d04 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:50.797526 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2f05d907-3202-4af4-9553-095d8f1d2d04 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:50.798208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2f05d907-3202-4af4-9553-095d8f1d2d04 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:50.798662 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2f05d907-3202-4af4-9553-095d8f1d2d04 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:50.799093 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2f05d907-3202-4af4-9553-095d8f1d2d04 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:50.927455 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2f05d907-3202-4af4-9553-095d8f1d2d04 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:50.936140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2f05d907-3202-4af4-9553-095d8f1d2d04 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1315 microversion: 2.1 time: 0.150063 Aug 19 16:32:50.936712 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 93/182] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:50 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:51.421525 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-56f5fc0c-b9ee-47fb-ba11-4e3717b74782 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:51.422053 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-56f5fc0c-b9ee-47fb-ba11-4e3717b74782 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:51.428376 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-56f5fc0c-b9ee-47fb-ba11-4e3717b74782 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:51.428885 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-56f5fc0c-b9ee-47fb-ba11-4e3717b74782 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:51.429319 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-56f5fc0c-b9ee-47fb-ba11-4e3717b74782 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:51.429990 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-56f5fc0c-b9ee-47fb-ba11-4e3717b74782 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:51.430440 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-56f5fc0c-b9ee-47fb-ba11-4e3717b74782 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:51.430942 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-56f5fc0c-b9ee-47fb-ba11-4e3717b74782 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:51.560107 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-56f5fc0c-b9ee-47fb-ba11-4e3717b74782 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:51.567606 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-56f5fc0c-b9ee-47fb-ba11-4e3717b74782 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1364 microversion: 2.1 time: 0.150059 Aug 19 16:32:51.568159 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 90/183] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:51 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:51.583315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f4dee273-9b4a-4f3a-81b4-ad886fdc97d3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:51.583985 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f4dee273-9b4a-4f3a-81b4-ad886fdc97d3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:51.590895 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f4dee273-9b4a-4f3a-81b4-ad886fdc97d3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:51.591380 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f4dee273-9b4a-4f3a-81b4-ad886fdc97d3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:51.591818 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f4dee273-9b4a-4f3a-81b4-ad886fdc97d3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:51.592885 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f4dee273-9b4a-4f3a-81b4-ad886fdc97d3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:51.592978 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f4dee273-9b4a-4f3a-81b4-ad886fdc97d3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:51.593388 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f4dee273-9b4a-4f3a-81b4-ad886fdc97d3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:51.639740 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-5dfba570-6ce7-47d6-8efa-f0f199518e8c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:51.640340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-5dfba570-6ce7-47d6-8efa-f0f199518e8c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:51.646299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5dfba570-6ce7-47d6-8efa-f0f199518e8c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:51.646773 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5dfba570-6ce7-47d6-8efa-f0f199518e8c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:51.647200 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5dfba570-6ce7-47d6-8efa-f0f199518e8c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:51.647880 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5dfba570-6ce7-47d6-8efa-f0f199518e8c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:51.648325 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5dfba570-6ce7-47d6-8efa-f0f199518e8c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:51.648740 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5dfba570-6ce7-47d6-8efa-f0f199518e8c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:51.733206 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f4dee273-9b4a-4f3a-81b4-ad886fdc97d3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:51.742220 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f4dee273-9b4a-4f3a-81b4-ad886fdc97d3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1321 microversion: 2.1 time: 0.162743 Aug 19 16:32:51.742789 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 94/184] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:51 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:51.748072 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d6c7cbc2-b825-4fde-a400-ff5f27c3c268 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:51.748909 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d6c7cbc2-b825-4fde-a400-ff5f27c3c268 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:51.757081 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d6c7cbc2-b825-4fde-a400-ff5f27c3c268 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:51.757689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d6c7cbc2-b825-4fde-a400-ff5f27c3c268 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:51.758317 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d6c7cbc2-b825-4fde-a400-ff5f27c3c268 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:51.759534 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d6c7cbc2-b825-4fde-a400-ff5f27c3c268 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:51.759993 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d6c7cbc2-b825-4fde-a400-ff5f27c3c268 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:51.760409 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d6c7cbc2-b825-4fde-a400-ff5f27c3c268 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:51.788422 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5dfba570-6ce7-47d6-8efa-f0f199518e8c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:51.797187 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-5dfba570-6ce7-47d6-8efa-f0f199518e8c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 0.161315 Aug 19 16:32:51.797742 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 91/185] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:51 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:51.828572 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d6c7cbc2-b825-4fde-a400-ff5f27c3c268 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:51.836487 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d6c7cbc2-b825-4fde-a400-ff5f27c3c268 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1270 microversion: 2.1 time: 0.092604 Aug 19 16:32:51.837287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 95/186] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:51 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:51.956979 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-77935145-905d-4d16-908e-1a8de0efe983 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:51.957583 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-77935145-905d-4d16-908e-1a8de0efe983 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:51.963684 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-77935145-905d-4d16-908e-1a8de0efe983 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:51.964169 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-77935145-905d-4d16-908e-1a8de0efe983 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:51.964595 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-77935145-905d-4d16-908e-1a8de0efe983 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:51.965308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-77935145-905d-4d16-908e-1a8de0efe983 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:51.965757 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-77935145-905d-4d16-908e-1a8de0efe983 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:51.966349 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-77935145-905d-4d16-908e-1a8de0efe983 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:52.111229 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-77935145-905d-4d16-908e-1a8de0efe983 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:52.121077 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-77935145-905d-4d16-908e-1a8de0efe983 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1315 microversion: 2.1 time: 0.167940 Aug 19 16:32:52.124923 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 92/187] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:51 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:52.591688 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1b31e452-903b-4d53-b9fc-797c89bb5bd8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:52.592718 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1b31e452-903b-4d53-b9fc-797c89bb5bd8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:52.603947 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1b31e452-903b-4d53-b9fc-797c89bb5bd8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:52.604434 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1b31e452-903b-4d53-b9fc-797c89bb5bd8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:52.604888 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1b31e452-903b-4d53-b9fc-797c89bb5bd8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:52.605578 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1b31e452-903b-4d53-b9fc-797c89bb5bd8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:52.606023 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1b31e452-903b-4d53-b9fc-797c89bb5bd8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:52.606437 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1b31e452-903b-4d53-b9fc-797c89bb5bd8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:52.764011 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a49f35b8-12e4-4421-94c1-bf7a057495d4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:52.765518 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a49f35b8-12e4-4421-94c1-bf7a057495d4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:52.770666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1b31e452-903b-4d53-b9fc-797c89bb5bd8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:52.777603 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a49f35b8-12e4-4421-94c1-bf7a057495d4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:52.778085 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a49f35b8-12e4-4421-94c1-bf7a057495d4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:52.778512 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a49f35b8-12e4-4421-94c1-bf7a057495d4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:52.779196 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a49f35b8-12e4-4421-94c1-bf7a057495d4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:52.779644 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a49f35b8-12e4-4421-94c1-bf7a057495d4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:52.780058 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a49f35b8-12e4-4421-94c1-bf7a057495d4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:52.785179 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1b31e452-903b-4d53-b9fc-797c89bb5bd8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1364 microversion: 2.1 time: 0.201325 Aug 19 16:32:52.785827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 96/188] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:52 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:52.819213 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-3a81b01b-b7c4-4e5f-bb77-67fe804675cf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:52.820387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-3a81b01b-b7c4-4e5f-bb77-67fe804675cf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:52.827586 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a81b01b-b7c4-4e5f-bb77-67fe804675cf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:52.828072 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a81b01b-b7c4-4e5f-bb77-67fe804675cf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:52.828713 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a81b01b-b7c4-4e5f-bb77-67fe804675cf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:52.829447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a81b01b-b7c4-4e5f-bb77-67fe804675cf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:52.829899 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a81b01b-b7c4-4e5f-bb77-67fe804675cf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:52.830599 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a81b01b-b7c4-4e5f-bb77-67fe804675cf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:52.966171 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-3a81b01b-b7c4-4e5f-bb77-67fe804675cf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:52.974121 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-3a81b01b-b7c4-4e5f-bb77-67fe804675cf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 0.159391 Aug 19 16:32:52.974798 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 97/189] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:52 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:52.979370 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-90680303-4d87-44ad-b678-9d0244b4d4e7 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:52.980046 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-90680303-4d87-44ad-b678-9d0244b4d4e7 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:52.987823 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-90680303-4d87-44ad-b678-9d0244b4d4e7 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:52.988314 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-90680303-4d87-44ad-b678-9d0244b4d4e7 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:52.988762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-90680303-4d87-44ad-b678-9d0244b4d4e7 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:52.989455 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-90680303-4d87-44ad-b678-9d0244b4d4e7 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:52.989900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-90680303-4d87-44ad-b678-9d0244b4d4e7 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:52.990320 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-90680303-4d87-44ad-b678-9d0244b4d4e7 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:53.003052 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a49f35b8-12e4-4421-94c1-bf7a057495d4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:53.016438 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a49f35b8-12e4-4421-94c1-bf7a057495d4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1321 microversion: 2.1 time: 0.256104 Aug 19 16:32:53.017272 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 93/190] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:52 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:53.121755 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-90680303-4d87-44ad-b678-9d0244b4d4e7 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:53.129830 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-90680303-4d87-44ad-b678-9d0244b4d4e7 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.154005 Aug 19 16:32:53.130390 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 98/191] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:52 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:53.141576 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8cedc2ff-ed8a-4b7d-9b7a-538716f7f034 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:53.142180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8cedc2ff-ed8a-4b7d-9b7a-538716f7f034 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:53.147908 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8cedc2ff-ed8a-4b7d-9b7a-538716f7f034 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:53.148376 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8cedc2ff-ed8a-4b7d-9b7a-538716f7f034 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:53.148825 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8cedc2ff-ed8a-4b7d-9b7a-538716f7f034 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:53.149571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8cedc2ff-ed8a-4b7d-9b7a-538716f7f034 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:53.150098 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8cedc2ff-ed8a-4b7d-9b7a-538716f7f034 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:53.150518 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8cedc2ff-ed8a-4b7d-9b7a-538716f7f034 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:53.283178 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-8cedc2ff-ed8a-4b7d-9b7a-538716f7f034 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:53.291205 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8cedc2ff-ed8a-4b7d-9b7a-538716f7f034 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1315 microversion: 2.1 time: 0.153280 Aug 19 16:32:53.291757 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 94/192] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:53 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:53.805712 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-891af9e3-ad60-45c0-aa54-3f680ca589df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:53.806315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-891af9e3-ad60-45c0-aa54-3f680ca589df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:53.814991 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-891af9e3-ad60-45c0-aa54-3f680ca589df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:53.815494 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-891af9e3-ad60-45c0-aa54-3f680ca589df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:53.816095 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-891af9e3-ad60-45c0-aa54-3f680ca589df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:53.816814 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-891af9e3-ad60-45c0-aa54-3f680ca589df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:53.817415 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-891af9e3-ad60-45c0-aa54-3f680ca589df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:53.817837 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-891af9e3-ad60-45c0-aa54-3f680ca589df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:53.969096 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-891af9e3-ad60-45c0-aa54-3f680ca589df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:53.978564 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-891af9e3-ad60-45c0-aa54-3f680ca589df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1554 microversion: 2.1 time: 0.176585 Aug 19 16:32:53.979162 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 99/193] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:53 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:53.994969 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-36d38fe0-f8a2-4109-8bf7-58840f1c2ffb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:53.995586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-36d38fe0-f8a2-4109-8bf7-58840f1c2ffb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:54.003707 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-36d38fe0-f8a2-4109-8bf7-58840f1c2ffb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:54.003971 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-4a0c6af2-df35-44e0-8ac9-a8a6234d409a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:54.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-4a0c6af2-df35-44e0-8ac9-a8a6234d409a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:54.004874 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-36d38fe0-f8a2-4109-8bf7-58840f1c2ffb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:54.005325 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-36d38fe0-f8a2-4109-8bf7-58840f1c2ffb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:54.006125 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-36d38fe0-f8a2-4109-8bf7-58840f1c2ffb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:54.006669 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-36d38fe0-f8a2-4109-8bf7-58840f1c2ffb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:54.007182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-36d38fe0-f8a2-4109-8bf7-58840f1c2ffb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:54.011989 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4a0c6af2-df35-44e0-8ac9-a8a6234d409a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:54.012672 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4a0c6af2-df35-44e0-8ac9-a8a6234d409a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:54.013272 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4a0c6af2-df35-44e0-8ac9-a8a6234d409a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:54.014116 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4a0c6af2-df35-44e0-8ac9-a8a6234d409a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:54.014569 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4a0c6af2-df35-44e0-8ac9-a8a6234d409a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:54.014995 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4a0c6af2-df35-44e0-8ac9-a8a6234d409a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:54.135814 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-4a0c6af2-df35-44e0-8ac9-a8a6234d409a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135715 Aug 19 16:32:54.136494 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 100/194] 10.222.0.55 () {58 vars in 1275 bytes} [Fri Aug 19 16:32:53 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:32:54.141504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-43ede483-50d7-435f-8432-52e3ba9e0cb5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:54.142112 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-43ede483-50d7-435f-8432-52e3ba9e0cb5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:54.144570 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-36d38fe0-f8a2-4109-8bf7-58840f1c2ffb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:54.149089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-43ede483-50d7-435f-8432-52e3ba9e0cb5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:54.150581 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-43ede483-50d7-435f-8432-52e3ba9e0cb5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:54.150581 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-43ede483-50d7-435f-8432-52e3ba9e0cb5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:54.151306 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-43ede483-50d7-435f-8432-52e3ba9e0cb5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:54.152058 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-43ede483-50d7-435f-8432-52e3ba9e0cb5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:54.152767 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-43ede483-50d7-435f-8432-52e3ba9e0cb5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:54.155853 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-36d38fe0-f8a2-4109-8bf7-58840f1c2ffb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 0.165019 Aug 19 16:32:54.156577 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 95/195] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:53 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:54.161416 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-42a3aceb-07ef-4c0e-aa81-2c56e289c818 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:54.162048 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-42a3aceb-07ef-4c0e-aa81-2c56e289c818 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:54.168161 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-42a3aceb-07ef-4c0e-aa81-2c56e289c818 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:54.168578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-42a3aceb-07ef-4c0e-aa81-2c56e289c818 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:54.169160 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-42a3aceb-07ef-4c0e-aa81-2c56e289c818 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:54.169867 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-42a3aceb-07ef-4c0e-aa81-2c56e289c818 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:54.170350 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-42a3aceb-07ef-4c0e-aa81-2c56e289c818 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:54.170566 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=100 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:54.170792 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-42a3aceb-07ef-4c0e-aa81-2c56e289c818 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:54.307925 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-42a3aceb-07ef-4c0e-aa81-2c56e289c818 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:54.316131 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-42a3aceb-07ef-4c0e-aa81-2c56e289c818 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.158582 Aug 19 16:32:54.316779 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 96/196] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:54 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:54.322537 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-18303dd4-59ad-431f-a9d7-007fabfdc563 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:54.323526 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-18303dd4-59ad-431f-a9d7-007fabfdc563 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:54.329823 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-18303dd4-59ad-431f-a9d7-007fabfdc563 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:54.330494 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-18303dd4-59ad-431f-a9d7-007fabfdc563 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:54.330921 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-18303dd4-59ad-431f-a9d7-007fabfdc563 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:54.331660 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-18303dd4-59ad-431f-a9d7-007fabfdc563 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:54.332156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-18303dd4-59ad-431f-a9d7-007fabfdc563 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:54.332718 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-18303dd4-59ad-431f-a9d7-007fabfdc563 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:54.473808 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-18303dd4-59ad-431f-a9d7-007fabfdc563 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:54.482738 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-18303dd4-59ad-431f-a9d7-007fabfdc563 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1503 microversion: 2.1 time: 0.164341 Aug 19 16:32:54.483329 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 97/197] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:54 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:54.493741 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-43ede483-50d7-435f-8432-52e3ba9e0cb5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:54.517204 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-43ede483-50d7-435f-8432-52e3ba9e0cb5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1514 microversion: 2.1 time: 0.376112 Aug 19 16:32:54.518115 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 101/198] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:54 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1514 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:54.538291 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-52e00c53-aeba-46ce-ae9b-4f17f62bd42c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:54.541026 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-52e00c53-aeba-46ce-ae9b-4f17f62bd42c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:54.549651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-52e00c53-aeba-46ce-ae9b-4f17f62bd42c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:54.550329 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-52e00c53-aeba-46ce-ae9b-4f17f62bd42c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:54.550939 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-52e00c53-aeba-46ce-ae9b-4f17f62bd42c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:54.551640 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-52e00c53-aeba-46ce-ae9b-4f17f62bd42c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:54.552382 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-52e00c53-aeba-46ce-ae9b-4f17f62bd42c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:54.552996 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-52e00c53-aeba-46ce-ae9b-4f17f62bd42c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:54.581761 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.objects.instance [None req-52e00c53-aeba-46ce-ae9b-4f17f62bd42c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lazy-loading 'flavor' on Instance uuid 665dc524-b20c-4aa5-8861-13ad96d28939 {{(pid=127285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:32:54.645499 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=100 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:54.739999 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-52e00c53-aeba-46ce-ae9b-4f17f62bd42c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "POST /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939/action" status: 200 len: 32 microversion: 2.1 time: 0.205520 Aug 19 16:32:54.740670 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 98/199] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Aug 19 16:32:54 2022] POST /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939/action => generated 32 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 16:32:54.751210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-90b38b86-eae1-45d0-8742-cfd7201244af tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:54.752136 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-90b38b86-eae1-45d0-8742-cfd7201244af tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:54.754488 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=2 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:54.766005 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-90b38b86-eae1-45d0-8742-cfd7201244af tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:54.770065 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-90b38b86-eae1-45d0-8742-cfd7201244af tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:54.770766 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-90b38b86-eae1-45d0-8742-cfd7201244af tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:54.772004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-90b38b86-eae1-45d0-8742-cfd7201244af tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:54.772730 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-90b38b86-eae1-45d0-8742-cfd7201244af tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:54.775168 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-90b38b86-eae1-45d0-8742-cfd7201244af tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:54.789510 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=8 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:32:55.182634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-53dba752-727c-4e00-8a89-473a78347954 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:55.183679 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-53dba752-727c-4e00-8a89-473a78347954 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:55.193086 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-53dba752-727c-4e00-8a89-473a78347954 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:55.194432 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-53dba752-727c-4e00-8a89-473a78347954 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:55.195028 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-53dba752-727c-4e00-8a89-473a78347954 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:55.197223 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-53dba752-727c-4e00-8a89-473a78347954 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:55.198574 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-53dba752-727c-4e00-8a89-473a78347954 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:55.199185 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-53dba752-727c-4e00-8a89-473a78347954 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:55.386481 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-90b38b86-eae1-45d0-8742-cfd7201244af tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:55.400150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-90b38b86-eae1-45d0-8742-cfd7201244af tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.649282 Aug 19 16:32:55.401915 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 102/200] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:54 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:55.424553 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7eb745c4-5ba0-4f6e-a95b-6f18f7c5b004 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:55.425672 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7eb745c4-5ba0-4f6e-a95b-6f18f7c5b004 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:55.433766 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7eb745c4-5ba0-4f6e-a95b-6f18f7c5b004 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:55.434460 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7eb745c4-5ba0-4f6e-a95b-6f18f7c5b004 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:55.435363 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7eb745c4-5ba0-4f6e-a95b-6f18f7c5b004 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:55.436793 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7eb745c4-5ba0-4f6e-a95b-6f18f7c5b004 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:55.437906 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7eb745c4-5ba0-4f6e-a95b-6f18f7c5b004 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:55.438718 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7eb745c4-5ba0-4f6e-a95b-6f18f7c5b004 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:55.503517 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-53dba752-727c-4e00-8a89-473a78347954 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:55.516066 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-53dba752-727c-4e00-8a89-473a78347954 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 0.338722 Aug 19 16:32:55.517133 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 99/201] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:55 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:55.693503 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-1bc61e9b-41e8-4813-9bd4-8ddc105f0c13 req-95a32acf-185b-4ac7-8dfc-fba043c89764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65a2b34-93a3-4706-8976-168dd7a63b2f", "tag": "34bb549a-511d-4a52-b403-c677e27dd664"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:55.708317 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-1bc61e9b-41e8-4813-9bd4-8ddc105f0c13 req-95a32acf-185b-4ac7-8dfc-fba043c89764 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:55.709593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-1bc61e9b-41e8-4813-9bd4-8ddc105f0c13 req-95a32acf-185b-4ac7-8dfc-fba043c89764 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:55.710180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-1bc61e9b-41e8-4813-9bd4-8ddc105f0c13 req-95a32acf-185b-4ac7-8dfc-fba043c89764 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:55.728392 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7eb745c4-5ba0-4f6e-a95b-6f18f7c5b004 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:55.739344 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7eb745c4-5ba0-4f6e-a95b-6f18f7c5b004 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.322943 Aug 19 16:32:55.741422 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-1bc61e9b-41e8-4813-9bd4-8ddc105f0c13 req-95a32acf-185b-4ac7-8dfc-fba043c89764 service nova] Creating event network-changed:34bb549a-511d-4a52-b403-c677e27dd664 for instance e65a2b34-93a3-4706-8976-168dd7a63b2f on hv-cinder-83124 Aug 19 16:32:55.741876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 103/202] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:55 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:55.762454 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-1bc61e9b-41e8-4813-9bd4-8ddc105f0c13 req-95a32acf-185b-4ac7-8dfc-fba043c89764 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073717 Aug 19 16:32:55.763396 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 100/203] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:32:55.979454 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-cb23170d-c01f-4bbb-a191-2af57624e4ae tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71276ec6-f0d8-45d5-803a-911f287edbe2"}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:55.983768 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-cb23170d-c01f-4bbb-a191-2af57624e4ae tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:55.990275 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cb23170d-c01f-4bbb-a191-2af57624e4ae tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:55.990752 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cb23170d-c01f-4bbb-a191-2af57624e4ae tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:55.991180 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cb23170d-c01f-4bbb-a191-2af57624e4ae tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:55.991896 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cb23170d-c01f-4bbb-a191-2af57624e4ae tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:55.992344 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cb23170d-c01f-4bbb-a191-2af57624e4ae tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:55.992774 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cb23170d-c01f-4bbb-a191-2af57624e4ae tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:56.175368 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-af22257d-1dc1-4ecd-a1ed-7e3964e6bcb1 req-b06adeb4-cc0c-409e-9d77-60213b32e1bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f1f3d4e-7c83-4d2b-a34f-4cac4b871285", "tag": "36d1a484-663f-4e9f-a220-92a99deec85f"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:32:56.202421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-af22257d-1dc1-4ecd-a1ed-7e3964e6bcb1 req-b06adeb4-cc0c-409e-9d77-60213b32e1bf service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:56.205057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-af22257d-1dc1-4ecd-a1ed-7e3964e6bcb1 req-b06adeb4-cc0c-409e-9d77-60213b32e1bf service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:56.205719 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-af22257d-1dc1-4ecd-a1ed-7e3964e6bcb1 req-b06adeb4-cc0c-409e-9d77-60213b32e1bf service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:56.218125 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-af22257d-1dc1-4ecd-a1ed-7e3964e6bcb1 req-b06adeb4-cc0c-409e-9d77-60213b32e1bf service nova] Creating event network-changed:36d1a484-663f-4e9f-a220-92a99deec85f for instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 on hv-cinder-83124 Aug 19 16:32:56.223651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-af22257d-1dc1-4ecd-a1ed-7e3964e6bcb1 req-b06adeb4-cc0c-409e-9d77-60213b32e1bf service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054837 Aug 19 16:32:56.224251 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 101/204] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:32:56.426728 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d72cd497-d56c-4649-8ea8-6e98e4f2e54e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:56.427840 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d72cd497-d56c-4649-8ea8-6e98e4f2e54e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:56.438213 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d72cd497-d56c-4649-8ea8-6e98e4f2e54e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:56.438804 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d72cd497-d56c-4649-8ea8-6e98e4f2e54e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:56.439335 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d72cd497-d56c-4649-8ea8-6e98e4f2e54e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:56.440146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d72cd497-d56c-4649-8ea8-6e98e4f2e54e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:56.440697 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d72cd497-d56c-4649-8ea8-6e98e4f2e54e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:56.441244 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d72cd497-d56c-4649-8ea8-6e98e4f2e54e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:56.644825 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d72cd497-d56c-4649-8ea8-6e98e4f2e54e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:56.647635 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d72cd497-d56c-4649-8ea8-6e98e4f2e54e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.225572 Aug 19 16:32:56.648395 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 102/205] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:56 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:56.665943 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-5ef9cb56-cb5a-4fae-8441-9c20a1b908cf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:56.666813 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-5ef9cb56-cb5a-4fae-8441-9c20a1b908cf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:56.673825 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5ef9cb56-cb5a-4fae-8441-9c20a1b908cf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:56.674359 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5ef9cb56-cb5a-4fae-8441-9c20a1b908cf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:56.675044 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5ef9cb56-cb5a-4fae-8441-9c20a1b908cf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:56.675576 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5ef9cb56-cb5a-4fae-8441-9c20a1b908cf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:56.676041 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5ef9cb56-cb5a-4fae-8441-9c20a1b908cf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:56.676497 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5ef9cb56-cb5a-4fae-8441-9c20a1b908cf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:56.895411 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5ef9cb56-cb5a-4fae-8441-9c20a1b908cf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:56.903761 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-5ef9cb56-cb5a-4fae-8441-9c20a1b908cf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 0.241812 Aug 19 16:32:56.912786 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 103/206] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:56 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:56.912786 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3da971c7-4ca6-44e8-b334-924b6b5fac5b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:56.912786 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-3da971c7-4ca6-44e8-b334-924b6b5fac5b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:56.920366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3da971c7-4ca6-44e8-b334-924b6b5fac5b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:56.920366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3da971c7-4ca6-44e8-b334-924b6b5fac5b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:56.920366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3da971c7-4ca6-44e8-b334-924b6b5fac5b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:56.920366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3da971c7-4ca6-44e8-b334-924b6b5fac5b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:56.920947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3da971c7-4ca6-44e8-b334-924b6b5fac5b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:56.920947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3da971c7-4ca6-44e8-b334-924b6b5fac5b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:57.112061 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-3da971c7-4ca6-44e8-b334-924b6b5fac5b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:57.126065 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3da971c7-4ca6-44e8-b334-924b6b5fac5b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.220196 Aug 19 16:32:57.129332 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 104/207] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:56 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:57.672393 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-390928dc-090e-40c5-8d4f-fc8487eb350c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:57.673219 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-390928dc-090e-40c5-8d4f-fc8487eb350c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:57.679135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-390928dc-090e-40c5-8d4f-fc8487eb350c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:57.679680 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-390928dc-090e-40c5-8d4f-fc8487eb350c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:57.680314 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-390928dc-090e-40c5-8d4f-fc8487eb350c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:57.685008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-390928dc-090e-40c5-8d4f-fc8487eb350c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:57.685585 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-390928dc-090e-40c5-8d4f-fc8487eb350c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:57.686156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-390928dc-090e-40c5-8d4f-fc8487eb350c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:57.826115 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-390928dc-090e-40c5-8d4f-fc8487eb350c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:57.833874 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-390928dc-090e-40c5-8d4f-fc8487eb350c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.165408 Aug 19 16:32:57.834680 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 105/208] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:57 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:57.927712 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a3c51959-6515-4d53-b00c-8900958d9242 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:57.928333 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a3c51959-6515-4d53-b00c-8900958d9242 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:57.938846 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a3c51959-6515-4d53-b00c-8900958d9242 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:57.939484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a3c51959-6515-4d53-b00c-8900958d9242 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:57.940022 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a3c51959-6515-4d53-b00c-8900958d9242 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:57.940852 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a3c51959-6515-4d53-b00c-8900958d9242 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:57.941409 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a3c51959-6515-4d53-b00c-8900958d9242 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:57.942072 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a3c51959-6515-4d53-b00c-8900958d9242 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:58.261932 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a3c51959-6515-4d53-b00c-8900958d9242 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:58.270240 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a3c51959-6515-4d53-b00c-8900958d9242 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1364 microversion: 2.1 time: 0.346525 Aug 19 16:32:58.270786 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 106/209] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:57 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1364 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:58.276059 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d4bae7ec-67f6-43a0-9f74-2aef969c75c4 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:58.276663 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d4bae7ec-67f6-43a0-9f74-2aef969c75c4 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:58.282546 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d4bae7ec-67f6-43a0-9f74-2aef969c75c4 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:58.283186 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d4bae7ec-67f6-43a0-9f74-2aef969c75c4 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:58.283804 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d4bae7ec-67f6-43a0-9f74-2aef969c75c4 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:58.284497 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d4bae7ec-67f6-43a0-9f74-2aef969c75c4 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:58.284978 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d4bae7ec-67f6-43a0-9f74-2aef969c75c4 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:58.285403 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d4bae7ec-67f6-43a0-9f74-2aef969c75c4 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:58.496893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d4bae7ec-67f6-43a0-9f74-2aef969c75c4 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:58.504443 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d4bae7ec-67f6-43a0-9f74-2aef969c75c4 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.232546 Aug 19 16:32:58.505037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 107/210] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:58 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:58.810522 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-cb23170d-c01f-4bbb-a191-2af57624e4ae tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "POST /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.837609 Aug 19 16:32:58.813199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 104/211] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Aug 19 16:32:55 2022] POST /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08/os-volume_attachments => generated 194 bytes in 2841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:32:58.855936 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-94fd020b-02fa-4f5b-ac5a-5bbba4601af9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:58.857160 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-94fd020b-02fa-4f5b-ac5a-5bbba4601af9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:58.863888 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-94fd020b-02fa-4f5b-ac5a-5bbba4601af9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:58.864612 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-94fd020b-02fa-4f5b-ac5a-5bbba4601af9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:58.865237 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-94fd020b-02fa-4f5b-ac5a-5bbba4601af9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:58.866111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-94fd020b-02fa-4f5b-ac5a-5bbba4601af9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:58.866898 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-94fd020b-02fa-4f5b-ac5a-5bbba4601af9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:58.867470 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-94fd020b-02fa-4f5b-ac5a-5bbba4601af9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:59.298780 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-39d20bef-e977-4c92-9645-354ece31cfc6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:59.298780 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-39d20bef-e977-4c92-9645-354ece31cfc6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:59.318856 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39d20bef-e977-4c92-9645-354ece31cfc6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:59.319505 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39d20bef-e977-4c92-9645-354ece31cfc6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:59.321801 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39d20bef-e977-4c92-9645-354ece31cfc6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:59.324232 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39d20bef-e977-4c92-9645-354ece31cfc6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:59.325726 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39d20bef-e977-4c92-9645-354ece31cfc6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:59.326428 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39d20bef-e977-4c92-9645-354ece31cfc6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:59.377297 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-94fd020b-02fa-4f5b-ac5a-5bbba4601af9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:59.388138 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-94fd020b-02fa-4f5b-ac5a-5bbba4601af9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.536409 Aug 19 16:32:59.388830 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 108/212] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:58 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:32:59.477078 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-39d20bef-e977-4c92-9645-354ece31cfc6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:59.484984 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-39d20bef-e977-4c92-9645-354ece31cfc6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1550 microversion: 2.1 time: 0.196866 Aug 19 16:32:59.485544 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 105/213] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:59 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1550 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:32:59.505738 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-bee0e932-35d6-4642-b3be-8fb624c9f883 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:59.506277 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-bee0e932-35d6-4642-b3be-8fb624c9f883 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:59.513017 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bee0e932-35d6-4642-b3be-8fb624c9f883 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:59.513720 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bee0e932-35d6-4642-b3be-8fb624c9f883 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:59.514160 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bee0e932-35d6-4642-b3be-8fb624c9f883 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:59.514854 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bee0e932-35d6-4642-b3be-8fb624c9f883 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:59.515313 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bee0e932-35d6-4642-b3be-8fb624c9f883 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:59.515740 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bee0e932-35d6-4642-b3be-8fb624c9f883 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:59.526353 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-3a7950cd-67cf-4927-a2a9-54628046c11c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:32:59.527079 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-3a7950cd-67cf-4927-a2a9-54628046c11c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:32:59.534221 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a7950cd-67cf-4927-a2a9-54628046c11c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:59.535327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a7950cd-67cf-4927-a2a9-54628046c11c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:59.535871 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a7950cd-67cf-4927-a2a9-54628046c11c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:59.536667 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a7950cd-67cf-4927-a2a9-54628046c11c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:32:59.537529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a7950cd-67cf-4927-a2a9-54628046c11c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:32:59.538092 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a7950cd-67cf-4927-a2a9-54628046c11c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:32:59.608034 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-bee0e932-35d6-4642-b3be-8fb624c9f883 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105695 Aug 19 16:32:59.608980 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 109/214] 10.222.0.55 () {58 vars in 1275 bytes} [Fri Aug 19 16:32:59 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:32:59.691650 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-3a7950cd-67cf-4927-a2a9-54628046c11c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:32:59.701127 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-3a7950cd-67cf-4927-a2a9-54628046c11c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.179361 Aug 19 16:32:59.701732 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 106/215] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:32:59 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:00.414132 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3915349d-fc75-4742-beb5-0b5cfab790ad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:00.416251 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-3915349d-fc75-4742-beb5-0b5cfab790ad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:00.432073 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3915349d-fc75-4742-beb5-0b5cfab790ad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:00.437444 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3915349d-fc75-4742-beb5-0b5cfab790ad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:00.438043 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3915349d-fc75-4742-beb5-0b5cfab790ad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:00.438992 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3915349d-fc75-4742-beb5-0b5cfab790ad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:00.440220 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3915349d-fc75-4742-beb5-0b5cfab790ad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:00.440848 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3915349d-fc75-4742-beb5-0b5cfab790ad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:00.723786 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7ea14647-5d7a-4a50-9e86-c48703f522ab tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:00.725079 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7ea14647-5d7a-4a50-9e86-c48703f522ab tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:00.733170 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7ea14647-5d7a-4a50-9e86-c48703f522ab tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:00.733837 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7ea14647-5d7a-4a50-9e86-c48703f522ab tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:00.734419 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7ea14647-5d7a-4a50-9e86-c48703f522ab tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:00.735256 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7ea14647-5d7a-4a50-9e86-c48703f522ab tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:00.735845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7ea14647-5d7a-4a50-9e86-c48703f522ab tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:00.736430 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7ea14647-5d7a-4a50-9e86-c48703f522ab tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:01.036313 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7ea14647-5d7a-4a50-9e86-c48703f522ab tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:01.047231 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7ea14647-5d7a-4a50-9e86-c48703f522ab tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.327022 Aug 19 16:33:01.048182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 107/216] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:00 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:01.287512 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-3915349d-fc75-4742-beb5-0b5cfab790ad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:01.298882 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3915349d-fc75-4742-beb5-0b5cfab790ad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.892059 Aug 19 16:33:01.314453 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 110/217] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:00 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:01.692445 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-0d972b36-5fb0-4fe2-bc60-a7906805ec5b req-c45a8db5-d8c2-42f2-99b2-00c204feb917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1eddf01-3fc7-4c5c-8560-96cddb34a199", "tag": "f7152602-0c68-468a-8871-72cc6f1ab0dc"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:33:01.712702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-0d972b36-5fb0-4fe2-bc60-a7906805ec5b req-c45a8db5-d8c2-42f2-99b2-00c204feb917 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:01.713227 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-0d972b36-5fb0-4fe2-bc60-a7906805ec5b req-c45a8db5-d8c2-42f2-99b2-00c204feb917 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:01.713662 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-0d972b36-5fb0-4fe2-bc60-a7906805ec5b req-c45a8db5-d8c2-42f2-99b2-00c204feb917 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:01.727749 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-0d972b36-5fb0-4fe2-bc60-a7906805ec5b req-c45a8db5-d8c2-42f2-99b2-00c204feb917 service nova] Creating event network-changed:f7152602-0c68-468a-8871-72cc6f1ab0dc for instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 on hv-cinder-83124 Aug 19 16:33:01.748119 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-0d972b36-5fb0-4fe2-bc60-a7906805ec5b req-c45a8db5-d8c2-42f2-99b2-00c204feb917 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059037 Aug 19 16:33:01.748672 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 108/218] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:33:02.068852 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-09fff0a2-3893-47ed-8e7b-ac4cb0ea09f1 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:02.070189 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-09fff0a2-3893-47ed-8e7b-ac4cb0ea09f1 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:02.088389 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-09fff0a2-3893-47ed-8e7b-ac4cb0ea09f1 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:02.092597 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-09fff0a2-3893-47ed-8e7b-ac4cb0ea09f1 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:02.096398 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-09fff0a2-3893-47ed-8e7b-ac4cb0ea09f1 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:02.100518 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-09fff0a2-3893-47ed-8e7b-ac4cb0ea09f1 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:02.101560 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-09fff0a2-3893-47ed-8e7b-ac4cb0ea09f1 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:02.103764 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-09fff0a2-3893-47ed-8e7b-ac4cb0ea09f1 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:02.320343 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-4d13a0ce-0cd9-4502-af59-253df0b8c50f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:02.322445 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-4d13a0ce-0cd9-4502-af59-253df0b8c50f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:02.340056 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4d13a0ce-0cd9-4502-af59-253df0b8c50f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:02.343593 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4d13a0ce-0cd9-4502-af59-253df0b8c50f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:02.344278 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4d13a0ce-0cd9-4502-af59-253df0b8c50f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:02.345122 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4d13a0ce-0cd9-4502-af59-253df0b8c50f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:02.345879 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4d13a0ce-0cd9-4502-af59-253df0b8c50f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:02.348850 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4d13a0ce-0cd9-4502-af59-253df0b8c50f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:02.635169 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-09fff0a2-3893-47ed-8e7b-ac4cb0ea09f1 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:02.660790 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-09fff0a2-3893-47ed-8e7b-ac4cb0ea09f1 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.587713 Aug 19 16:33:02.662706 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-4d13a0ce-0cd9-4502-af59-253df0b8c50f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:02.673702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-4d13a0ce-0cd9-4502-af59-253df0b8c50f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.357396 Aug 19 16:33:02.674826 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 109/219] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:02 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:02.685126 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 111/220] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:02 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:03.687257 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a96d5318-b7f0-47f3-875e-d6e345c2fa08 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:03.688088 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a96d5318-b7f0-47f3-875e-d6e345c2fa08 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:03.694505 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a96d5318-b7f0-47f3-875e-d6e345c2fa08 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:03.695077 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a96d5318-b7f0-47f3-875e-d6e345c2fa08 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:03.695626 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a96d5318-b7f0-47f3-875e-d6e345c2fa08 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:03.696457 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a96d5318-b7f0-47f3-875e-d6e345c2fa08 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:03.700141 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a96d5318-b7f0-47f3-875e-d6e345c2fa08 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:03.700141 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a96d5318-b7f0-47f3-875e-d6e345c2fa08 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:03.700311 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-3bb3822a-a4cc-45c2-9ccb-cc4956a8a6d8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:03.700311 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-3bb3822a-a4cc-45c2-9ccb-cc4956a8a6d8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:03.706533 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3bb3822a-a4cc-45c2-9ccb-cc4956a8a6d8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:03.707183 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3bb3822a-a4cc-45c2-9ccb-cc4956a8a6d8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:03.707624 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3bb3822a-a4cc-45c2-9ccb-cc4956a8a6d8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:03.708369 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3bb3822a-a4cc-45c2-9ccb-cc4956a8a6d8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:03.709158 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3bb3822a-a4cc-45c2-9ccb-cc4956a8a6d8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:03.709583 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3bb3822a-a4cc-45c2-9ccb-cc4956a8a6d8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:03.859216 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a96d5318-b7f0-47f3-875e-d6e345c2fa08 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:03.868727 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a96d5318-b7f0-47f3-875e-d6e345c2fa08 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.186347 Aug 19 16:33:03.869854 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 112/221] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:03 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:03.882974 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-3bb3822a-a4cc-45c2-9ccb-cc4956a8a6d8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:03.887021 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-3bb3822a-a4cc-45c2-9ccb-cc4956a8a6d8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.193421 Aug 19 16:33:03.887651 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 110/222] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:03 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:04.890454 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8e540aad-58fa-4a24-aba1-c38dbe5b34fd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:04.890978 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8e540aad-58fa-4a24-aba1-c38dbe5b34fd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:04.897014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8e540aad-58fa-4a24-aba1-c38dbe5b34fd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:04.897496 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8e540aad-58fa-4a24-aba1-c38dbe5b34fd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:04.897926 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8e540aad-58fa-4a24-aba1-c38dbe5b34fd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:04.899093 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8e540aad-58fa-4a24-aba1-c38dbe5b34fd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:04.899568 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8e540aad-58fa-4a24-aba1-c38dbe5b34fd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:04.899987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8e540aad-58fa-4a24-aba1-c38dbe5b34fd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:04.909109 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-77846d47-85f3-48a5-9009-14234a0f64df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:04.909721 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-77846d47-85f3-48a5-9009-14234a0f64df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:04.913306 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:33:04.917849 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-77846d47-85f3-48a5-9009-14234a0f64df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:04.918337 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-77846d47-85f3-48a5-9009-14234a0f64df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:04.918780 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-77846d47-85f3-48a5-9009-14234a0f64df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:04.919473 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-77846d47-85f3-48a5-9009-14234a0f64df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:04.919927 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-77846d47-85f3-48a5-9009-14234a0f64df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:04.920346 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-77846d47-85f3-48a5-9009-14234a0f64df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:05.031733 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-8e540aad-58fa-4a24-aba1-c38dbe5b34fd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:05.039896 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8e540aad-58fa-4a24-aba1-c38dbe5b34fd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.152673 Aug 19 16:33:05.040519 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 113/223] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:04 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:05.049433 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-77846d47-85f3-48a5-9009-14234a0f64df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:05.057191 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-77846d47-85f3-48a5-9009-14234a0f64df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.151766 Aug 19 16:33:05.057753 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 111/224] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:04 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:06.061317 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b9cb5abe-4a2f-40b0-ab43-e40de4833aa6 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:06.061918 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b9cb5abe-4a2f-40b0-ab43-e40de4833aa6 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:06.067679 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b9cb5abe-4a2f-40b0-ab43-e40de4833aa6 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:06.068148 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b9cb5abe-4a2f-40b0-ab43-e40de4833aa6 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:06.068575 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b9cb5abe-4a2f-40b0-ab43-e40de4833aa6 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:06.069276 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b9cb5abe-4a2f-40b0-ab43-e40de4833aa6 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:06.069722 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b9cb5abe-4a2f-40b0-ab43-e40de4833aa6 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:06.070136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b9cb5abe-4a2f-40b0-ab43-e40de4833aa6 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:06.077712 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a8339bf3-01c0-49af-9576-5101d11eea06 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:06.078321 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a8339bf3-01c0-49af-9576-5101d11eea06 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:06.084955 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a8339bf3-01c0-49af-9576-5101d11eea06 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:06.085377 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a8339bf3-01c0-49af-9576-5101d11eea06 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:06.085813 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a8339bf3-01c0-49af-9576-5101d11eea06 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:06.086771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a8339bf3-01c0-49af-9576-5101d11eea06 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:06.087333 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a8339bf3-01c0-49af-9576-5101d11eea06 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:06.088315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a8339bf3-01c0-49af-9576-5101d11eea06 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:06.200255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b9cb5abe-4a2f-40b0-ab43-e40de4833aa6 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:06.207803 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b9cb5abe-4a2f-40b0-ab43-e40de4833aa6 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.150359 Aug 19 16:33:06.208443 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 114/225] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:06 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:06.216103 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a8339bf3-01c0-49af-9576-5101d11eea06 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:06.223789 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a8339bf3-01c0-49af-9576-5101d11eea06 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.149976 Aug 19 16:33:06.224333 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 112/226] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:06 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:07.229711 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1888aa9c-192a-4c37-b12b-e8df7d34d994 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:07.230484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-1888aa9c-192a-4c37-b12b-e8df7d34d994 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:07.236489 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1888aa9c-192a-4c37-b12b-e8df7d34d994 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:07.237074 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1888aa9c-192a-4c37-b12b-e8df7d34d994 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:07.237569 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1888aa9c-192a-4c37-b12b-e8df7d34d994 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:07.238328 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1888aa9c-192a-4c37-b12b-e8df7d34d994 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:07.238766 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1888aa9c-192a-4c37-b12b-e8df7d34d994 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:07.239183 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1888aa9c-192a-4c37-b12b-e8df7d34d994 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:07.244764 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-93729ae3-60d6-4b47-b8c8-5c7729a96c74 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:07.252596 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-93729ae3-60d6-4b47-b8c8-5c7729a96c74 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:07.259112 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-93729ae3-60d6-4b47-b8c8-5c7729a96c74 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:07.259777 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-93729ae3-60d6-4b47-b8c8-5c7729a96c74 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:07.260000 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-93729ae3-60d6-4b47-b8c8-5c7729a96c74 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:07.260683 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-93729ae3-60d6-4b47-b8c8-5c7729a96c74 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:07.261354 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-93729ae3-60d6-4b47-b8c8-5c7729a96c74 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:07.261772 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-93729ae3-60d6-4b47-b8c8-5c7729a96c74 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:07.264332 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:33:07.394525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-93729ae3-60d6-4b47-b8c8-5c7729a96c74 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:07.403805 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-93729ae3-60d6-4b47-b8c8-5c7729a96c74 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.162718 Aug 19 16:33:07.404388 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 113/227] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:07 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:07.429237 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1888aa9c-192a-4c37-b12b-e8df7d34d994 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:07.437656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-1888aa9c-192a-4c37-b12b-e8df7d34d994 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.212358 Aug 19 16:33:07.438229 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 115/228] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:07 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:08.430785 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-35fdf441-4a89-4360-bbdc-1dccf7d9c122 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:08.431316 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-35fdf441-4a89-4360-bbdc-1dccf7d9c122 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:08.438208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35fdf441-4a89-4360-bbdc-1dccf7d9c122 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:08.438900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35fdf441-4a89-4360-bbdc-1dccf7d9c122 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:08.439337 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35fdf441-4a89-4360-bbdc-1dccf7d9c122 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:08.440176 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35fdf441-4a89-4360-bbdc-1dccf7d9c122 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:08.440660 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35fdf441-4a89-4360-bbdc-1dccf7d9c122 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:08.441101 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35fdf441-4a89-4360-bbdc-1dccf7d9c122 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:08.459826 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d37523b0-7017-4ec3-a104-06723c29a4a9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:08.460559 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d37523b0-7017-4ec3-a104-06723c29a4a9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:08.469307 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d37523b0-7017-4ec3-a104-06723c29a4a9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:08.469788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d37523b0-7017-4ec3-a104-06723c29a4a9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:08.470219 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d37523b0-7017-4ec3-a104-06723c29a4a9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:08.470909 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d37523b0-7017-4ec3-a104-06723c29a4a9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:08.471359 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d37523b0-7017-4ec3-a104-06723c29a4a9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:08.471778 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d37523b0-7017-4ec3-a104-06723c29a4a9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:08.630671 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-35fdf441-4a89-4360-bbdc-1dccf7d9c122 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:08.639931 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-35fdf441-4a89-4360-bbdc-1dccf7d9c122 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.213507 Aug 19 16:33:08.640875 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 114/229] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:08 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:08.651816 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d37523b0-7017-4ec3-a104-06723c29a4a9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:08.667827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d37523b0-7017-4ec3-a104-06723c29a4a9 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.212372 Aug 19 16:33:08.668490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 116/230] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:08 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:09.174252 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-8efe5707-3c20-475a-bc9e-f9a350791eff req-7728e90f-98be-40d4-ae50-7b4932edab9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65a2b34-93a3-4706-8976-168dd7a63b2f", "name": "network-vif-plugged", "status": "completed", "tag": "34bb549a-511d-4a52-b403-c677e27dd664"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:33:09.183641 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-8efe5707-3c20-475a-bc9e-f9a350791eff req-7728e90f-98be-40d4-ae50-7b4932edab9a service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:09.184119 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-8efe5707-3c20-475a-bc9e-f9a350791eff req-7728e90f-98be-40d4-ae50-7b4932edab9a service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:09.184538 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-8efe5707-3c20-475a-bc9e-f9a350791eff req-7728e90f-98be-40d4-ae50-7b4932edab9a service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:09.197939 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-8efe5707-3c20-475a-bc9e-f9a350791eff req-7728e90f-98be-40d4-ae50-7b4932edab9a service nova] Creating event network-vif-plugged:34bb549a-511d-4a52-b403-c677e27dd664 for instance e65a2b34-93a3-4706-8976-168dd7a63b2f on hv-cinder-83124 Aug 19 16:33:09.204410 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-8efe5707-3c20-475a-bc9e-f9a350791eff req-7728e90f-98be-40d4-ae50-7b4932edab9a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035893 Aug 19 16:33:09.205246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 115/231] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:33:09.668901 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-06f82a2c-3b78-438f-8838-ccefe049c11a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:09.669514 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-06f82a2c-3b78-438f-8838-ccefe049c11a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:09.675883 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06f82a2c-3b78-438f-8838-ccefe049c11a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:09.676408 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06f82a2c-3b78-438f-8838-ccefe049c11a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:09.676906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06f82a2c-3b78-438f-8838-ccefe049c11a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:09.677611 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06f82a2c-3b78-438f-8838-ccefe049c11a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:09.678448 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06f82a2c-3b78-438f-8838-ccefe049c11a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:09.678645 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06f82a2c-3b78-438f-8838-ccefe049c11a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:09.697155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e716a973-591e-450f-8ad7-97eb3601d24f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:09.699729 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-e716a973-591e-450f-8ad7-97eb3601d24f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:09.709351 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e716a973-591e-450f-8ad7-97eb3601d24f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:09.710089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e716a973-591e-450f-8ad7-97eb3601d24f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:09.710724 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e716a973-591e-450f-8ad7-97eb3601d24f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:09.712237 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e716a973-591e-450f-8ad7-97eb3601d24f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:09.712941 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e716a973-591e-450f-8ad7-97eb3601d24f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:09.713580 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e716a973-591e-450f-8ad7-97eb3601d24f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:09.883795 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-06f82a2c-3b78-438f-8838-ccefe049c11a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:09.888293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e716a973-591e-450f-8ad7-97eb3601d24f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:09.892326 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-06f82a2c-3b78-438f-8838-ccefe049c11a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.227300 Aug 19 16:33:09.893367 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 117/232] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:09 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:09.899053 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e716a973-591e-450f-8ad7-97eb3601d24f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.207876 Aug 19 16:33:09.900323 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 116/233] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:09 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:10.833375 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-cb26554c-9609-47cb-9d84-4c9fbc47bc09 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:10.834214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-cb26554c-9609-47cb-9d84-4c9fbc47bc09 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:10.840655 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cb26554c-9609-47cb-9d84-4c9fbc47bc09 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:10.841169 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cb26554c-9609-47cb-9d84-4c9fbc47bc09 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:10.841600 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cb26554c-9609-47cb-9d84-4c9fbc47bc09 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:10.842286 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cb26554c-9609-47cb-9d84-4c9fbc47bc09 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:10.842738 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cb26554c-9609-47cb-9d84-4c9fbc47bc09 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:10.843157 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cb26554c-9609-47cb-9d84-4c9fbc47bc09 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:10.870317 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-cb26554c-9609-47cb-9d84-4c9fbc47bc09 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Going to try to terminate instance {{(pid=127285) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:33:10.916153 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e918b7ee-43f8-4aa5-917e-f6292c41fe20 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:10.917332 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-e918b7ee-43f8-4aa5-917e-f6292c41fe20 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:10.923948 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e918b7ee-43f8-4aa5-917e-f6292c41fe20 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:10.924614 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e918b7ee-43f8-4aa5-917e-f6292c41fe20 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:10.925348 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e918b7ee-43f8-4aa5-917e-f6292c41fe20 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:10.925914 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e918b7ee-43f8-4aa5-917e-f6292c41fe20 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:10.926358 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e918b7ee-43f8-4aa5-917e-f6292c41fe20 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:10.926963 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e918b7ee-43f8-4aa5-917e-f6292c41fe20 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:10.955305 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-cb26554c-9609-47cb-9d84-4c9fbc47bc09 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "DELETE /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 204 len: 0 microversion: 2.1 time: 0.125413 Aug 19 16:33:10.956159 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 118/234] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:33:10 2022] DELETE /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:33:10.962349 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-21792e9a-a7f6-4d96-9e2a-e86a1ac52f83 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:10.963048 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-21792e9a-a7f6-4d96-9e2a-e86a1ac52f83 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:10.968778 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-21792e9a-a7f6-4d96-9e2a-e86a1ac52f83 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:10.969278 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-21792e9a-a7f6-4d96-9e2a-e86a1ac52f83 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:10.972057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-21792e9a-a7f6-4d96-9e2a-e86a1ac52f83 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:10.972057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-21792e9a-a7f6-4d96-9e2a-e86a1ac52f83 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:10.972057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-21792e9a-a7f6-4d96-9e2a-e86a1ac52f83 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:10.972057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-21792e9a-a7f6-4d96-9e2a-e86a1ac52f83 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:11.063936 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e918b7ee-43f8-4aa5-917e-f6292c41fe20 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:11.067731 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:33:11.073538 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e918b7ee-43f8-4aa5-917e-f6292c41fe20 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.161912 Aug 19 16:33:11.086661 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 117/235] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:10 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:11.093302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-38c2859e-7cc4-48ee-8db1-4d650b844017 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:11.093916 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-38c2859e-7cc4-48ee-8db1-4d650b844017 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:11.101823 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-38c2859e-7cc4-48ee-8db1-4d650b844017 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:11.102578 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-38c2859e-7cc4-48ee-8db1-4d650b844017 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:11.103016 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-38c2859e-7cc4-48ee-8db1-4d650b844017 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:11.103709 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-38c2859e-7cc4-48ee-8db1-4d650b844017 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:11.104667 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-38c2859e-7cc4-48ee-8db1-4d650b844017 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:11.105108 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-38c2859e-7cc4-48ee-8db1-4d650b844017 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:11.168946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-21792e9a-a7f6-4d96-9e2a-e86a1ac52f83 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:11.177419 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-21792e9a-a7f6-4d96-9e2a-e86a1ac52f83 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.220048 Aug 19 16:33:11.178087 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 119/236] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:10 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:11.250363 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-38c2859e-7cc4-48ee-8db1-4d650b844017 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:11.258673 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-38c2859e-7cc4-48ee-8db1-4d650b844017 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1555 microversion: 2.1 time: 0.170117 Aug 19 16:33:11.259234 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 118/237] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:11 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:12.095639 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-faba33c3-fea2-4e73-aaad-879a51454c78 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:12.096247 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-faba33c3-fea2-4e73-aaad-879a51454c78 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:12.102400 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-faba33c3-fea2-4e73-aaad-879a51454c78 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:12.102872 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-faba33c3-fea2-4e73-aaad-879a51454c78 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:12.103298 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-faba33c3-fea2-4e73-aaad-879a51454c78 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:12.103975 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-faba33c3-fea2-4e73-aaad-879a51454c78 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:12.104420 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-faba33c3-fea2-4e73-aaad-879a51454c78 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:12.104863 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-faba33c3-fea2-4e73-aaad-879a51454c78 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:12.199446 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-9fe736a2-67cc-4358-8ee3-3e80b6398513 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:12.200367 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-9fe736a2-67cc-4358-8ee3-3e80b6398513 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:12.206932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9fe736a2-67cc-4358-8ee3-3e80b6398513 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:12.207420 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9fe736a2-67cc-4358-8ee3-3e80b6398513 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:12.207857 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9fe736a2-67cc-4358-8ee3-3e80b6398513 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:12.208825 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9fe736a2-67cc-4358-8ee3-3e80b6398513 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:12.209282 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9fe736a2-67cc-4358-8ee3-3e80b6398513 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:12.209711 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9fe736a2-67cc-4358-8ee3-3e80b6398513 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:12.235497 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-faba33c3-fea2-4e73-aaad-879a51454c78 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:12.243280 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-faba33c3-fea2-4e73-aaad-879a51454c78 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.151469 Aug 19 16:33:12.243944 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 120/238] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:12 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:12.280246 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-5782b520-44a2-4178-aa13-307d273a6d2a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:12.281015 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-5782b520-44a2-4178-aa13-307d273a6d2a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:12.286901 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5782b520-44a2-4178-aa13-307d273a6d2a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:12.287384 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5782b520-44a2-4178-aa13-307d273a6d2a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:12.287818 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5782b520-44a2-4178-aa13-307d273a6d2a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:12.288500 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5782b520-44a2-4178-aa13-307d273a6d2a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:12.289143 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5782b520-44a2-4178-aa13-307d273a6d2a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:12.289571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5782b520-44a2-4178-aa13-307d273a6d2a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:12.341910 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-9fe736a2-67cc-4358-8ee3-3e80b6398513 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:12.349684 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-9fe736a2-67cc-4358-8ee3-3e80b6398513 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.154674 Aug 19 16:33:12.350256 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 119/239] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:12 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:12.420085 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5782b520-44a2-4178-aa13-307d273a6d2a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:12.428386 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-5782b520-44a2-4178-aa13-307d273a6d2a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1555 microversion: 2.1 time: 0.151975 Aug 19 16:33:12.428979 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 121/240] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:12 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:13.263229 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-15e26d95-f727-4261-b04f-af784e49aa8f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:13.263977 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-15e26d95-f727-4261-b04f-af784e49aa8f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:13.270642 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-15e26d95-f727-4261-b04f-af784e49aa8f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:13.271124 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-15e26d95-f727-4261-b04f-af784e49aa8f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:13.271561 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-15e26d95-f727-4261-b04f-af784e49aa8f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:13.272279 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-15e26d95-f727-4261-b04f-af784e49aa8f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:13.272736 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-15e26d95-f727-4261-b04f-af784e49aa8f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:13.273738 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-15e26d95-f727-4261-b04f-af784e49aa8f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:13.370273 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-35b06ddd-9065-4124-999f-08ee54063953 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:13.370879 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-35b06ddd-9065-4124-999f-08ee54063953 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:13.373917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:33:13.377915 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-35b06ddd-9065-4124-999f-08ee54063953 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:13.378402 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-35b06ddd-9065-4124-999f-08ee54063953 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:13.378834 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-35b06ddd-9065-4124-999f-08ee54063953 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:13.379520 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-35b06ddd-9065-4124-999f-08ee54063953 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:13.379970 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-35b06ddd-9065-4124-999f-08ee54063953 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:13.380390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-35b06ddd-9065-4124-999f-08ee54063953 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:13.403013 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-15e26d95-f727-4261-b04f-af784e49aa8f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:13.410626 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-15e26d95-f727-4261-b04f-af784e49aa8f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.151158 Aug 19 16:33:13.411186 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 120/241] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:13 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:13.449215 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-fbaf0c43-7104-42c8-a8f4-2d7dd7a0abad tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:13.449919 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-fbaf0c43-7104-42c8-a8f4-2d7dd7a0abad tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:13.456146 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fbaf0c43-7104-42c8-a8f4-2d7dd7a0abad tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:13.456622 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fbaf0c43-7104-42c8-a8f4-2d7dd7a0abad tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:13.457135 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fbaf0c43-7104-42c8-a8f4-2d7dd7a0abad tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:13.457904 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fbaf0c43-7104-42c8-a8f4-2d7dd7a0abad tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:13.458424 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fbaf0c43-7104-42c8-a8f4-2d7dd7a0abad tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:13.459534 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fbaf0c43-7104-42c8-a8f4-2d7dd7a0abad tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:13.512073 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-35b06ddd-9065-4124-999f-08ee54063953 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:13.519920 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-35b06ddd-9065-4124-999f-08ee54063953 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.153544 Aug 19 16:33:13.520563 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 122/242] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:13 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:13.593090 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-fbaf0c43-7104-42c8-a8f4-2d7dd7a0abad tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:13.601319 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-fbaf0c43-7104-42c8-a8f4-2d7dd7a0abad tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1555 microversion: 2.1 time: 0.156401 Aug 19 16:33:13.602036 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 121/243] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:13 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:14.431728 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-dcd37648-37fc-4e89-8495-ee920a6d8e77 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:14.432334 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-dcd37648-37fc-4e89-8495-ee920a6d8e77 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:14.438311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dcd37648-37fc-4e89-8495-ee920a6d8e77 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:14.438791 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dcd37648-37fc-4e89-8495-ee920a6d8e77 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:14.439224 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dcd37648-37fc-4e89-8495-ee920a6d8e77 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:14.439906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dcd37648-37fc-4e89-8495-ee920a6d8e77 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:14.440357 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dcd37648-37fc-4e89-8495-ee920a6d8e77 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:14.440795 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dcd37648-37fc-4e89-8495-ee920a6d8e77 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:14.541799 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8e8ed1b9-6e5c-4c6f-b8f6-1bda658a5b99 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:14.542408 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8e8ed1b9-6e5c-4c6f-b8f6-1bda658a5b99 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:14.549825 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8e8ed1b9-6e5c-4c6f-b8f6-1bda658a5b99 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:14.550311 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8e8ed1b9-6e5c-4c6f-b8f6-1bda658a5b99 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:14.551403 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8e8ed1b9-6e5c-4c6f-b8f6-1bda658a5b99 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:14.552116 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8e8ed1b9-6e5c-4c6f-b8f6-1bda658a5b99 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:14.552574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8e8ed1b9-6e5c-4c6f-b8f6-1bda658a5b99 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:14.553048 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8e8ed1b9-6e5c-4c6f-b8f6-1bda658a5b99 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:14.571842 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-dcd37648-37fc-4e89-8495-ee920a6d8e77 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:14.579433 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-dcd37648-37fc-4e89-8495-ee920a6d8e77 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.152032 Aug 19 16:33:14.580205 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 123/244] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:14 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:14.622196 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3cebf1fb-624b-44a0-aa8f-d45e38add274 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:14.623048 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-3cebf1fb-624b-44a0-aa8f-d45e38add274 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:14.629169 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3cebf1fb-624b-44a0-aa8f-d45e38add274 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:14.629653 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3cebf1fb-624b-44a0-aa8f-d45e38add274 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:14.630087 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3cebf1fb-624b-44a0-aa8f-d45e38add274 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:14.630761 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3cebf1fb-624b-44a0-aa8f-d45e38add274 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:14.631206 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3cebf1fb-624b-44a0-aa8f-d45e38add274 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:14.631896 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3cebf1fb-624b-44a0-aa8f-d45e38add274 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:14.685270 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8e8ed1b9-6e5c-4c6f-b8f6-1bda658a5b99 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:14.693020 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8e8ed1b9-6e5c-4c6f-b8f6-1bda658a5b99 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.155638 Aug 19 16:33:14.693585 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 122/245] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:14 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:14.761387 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-3cebf1fb-624b-44a0-aa8f-d45e38add274 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:14.769464 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3cebf1fb-624b-44a0-aa8f-d45e38add274 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1555 microversion: 2.1 time: 0.151040 Aug 19 16:33:14.769941 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 124/246] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:14 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:15.602016 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c9d4a43e-e6ba-4553-bfd9-d666ccceeb0a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:15.602780 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-c9d4a43e-e6ba-4553-bfd9-d666ccceeb0a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:15.609686 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c9d4a43e-e6ba-4553-bfd9-d666ccceeb0a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:15.610232 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c9d4a43e-e6ba-4553-bfd9-d666ccceeb0a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:15.610670 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c9d4a43e-e6ba-4553-bfd9-d666ccceeb0a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:15.611387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c9d4a43e-e6ba-4553-bfd9-d666ccceeb0a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:15.611839 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c9d4a43e-e6ba-4553-bfd9-d666ccceeb0a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:15.612265 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c9d4a43e-e6ba-4553-bfd9-d666ccceeb0a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:15.715115 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c2b77321-78ae-4c4d-b63f-cb8bf0a47461 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:15.715735 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c2b77321-78ae-4c4d-b63f-cb8bf0a47461 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:15.721771 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2b77321-78ae-4c4d-b63f-cb8bf0a47461 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:15.722324 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2b77321-78ae-4c4d-b63f-cb8bf0a47461 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:15.722766 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2b77321-78ae-4c4d-b63f-cb8bf0a47461 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:15.723501 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2b77321-78ae-4c4d-b63f-cb8bf0a47461 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:15.723954 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2b77321-78ae-4c4d-b63f-cb8bf0a47461 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:15.724418 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2b77321-78ae-4c4d-b63f-cb8bf0a47461 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:15.743100 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c9d4a43e-e6ba-4553-bfd9-d666ccceeb0a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:15.751588 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c9d4a43e-e6ba-4553-bfd9-d666ccceeb0a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.154494 Aug 19 16:33:15.752237 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 123/247] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:15 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:15.790794 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a86321a5-23b9-47d6-b311-bd62b2d8c7fe tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:15.791489 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a86321a5-23b9-47d6-b311-bd62b2d8c7fe tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:15.797517 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a86321a5-23b9-47d6-b311-bd62b2d8c7fe tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:15.798184 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a86321a5-23b9-47d6-b311-bd62b2d8c7fe tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:15.798680 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a86321a5-23b9-47d6-b311-bd62b2d8c7fe tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:15.799590 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a86321a5-23b9-47d6-b311-bd62b2d8c7fe tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:15.800230 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a86321a5-23b9-47d6-b311-bd62b2d8c7fe tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:15.800719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a86321a5-23b9-47d6-b311-bd62b2d8c7fe tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:15.878825 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c2b77321-78ae-4c4d-b63f-cb8bf0a47461 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:15.887048 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c2b77321-78ae-4c4d-b63f-cb8bf0a47461 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.176654 Aug 19 16:33:15.887713 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 125/248] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:15 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:15.939701 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a86321a5-23b9-47d6-b311-bd62b2d8c7fe tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:15.949974 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a86321a5-23b9-47d6-b311-bd62b2d8c7fe tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1555 microversion: 2.1 time: 0.163648 Aug 19 16:33:15.950551 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 124/249] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:15 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:16.774867 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-159b58d2-3192-4e12-b127-0cfa13c4a4b0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:16.775474 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-159b58d2-3192-4e12-b127-0cfa13c4a4b0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:16.781778 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-159b58d2-3192-4e12-b127-0cfa13c4a4b0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:16.782258 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-159b58d2-3192-4e12-b127-0cfa13c4a4b0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:16.782685 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-159b58d2-3192-4e12-b127-0cfa13c4a4b0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:16.783368 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-159b58d2-3192-4e12-b127-0cfa13c4a4b0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:16.783812 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-159b58d2-3192-4e12-b127-0cfa13c4a4b0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:16.784226 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-159b58d2-3192-4e12-b127-0cfa13c4a4b0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:16.908067 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d254b191-6ff3-4ae0-a1e2-07787cbd71bb tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:16.909808 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d254b191-6ff3-4ae0-a1e2-07787cbd71bb tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:16.917408 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d254b191-6ff3-4ae0-a1e2-07787cbd71bb tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:16.917890 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d254b191-6ff3-4ae0-a1e2-07787cbd71bb tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:16.918318 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d254b191-6ff3-4ae0-a1e2-07787cbd71bb tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:16.919014 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d254b191-6ff3-4ae0-a1e2-07787cbd71bb tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:16.919495 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d254b191-6ff3-4ae0-a1e2-07787cbd71bb tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:16.919916 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d254b191-6ff3-4ae0-a1e2-07787cbd71bb tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:16.931305 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-159b58d2-3192-4e12-b127-0cfa13c4a4b0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:16.938944 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-159b58d2-3192-4e12-b127-0cfa13c4a4b0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.168775 Aug 19 16:33:16.939555 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 126/250] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:16 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:16.970371 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4eafce7a-628d-4db3-8a41-469a4d5dcf19 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:16.970959 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-4eafce7a-628d-4db3-8a41-469a4d5dcf19 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:16.977368 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4eafce7a-628d-4db3-8a41-469a4d5dcf19 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:16.977839 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4eafce7a-628d-4db3-8a41-469a4d5dcf19 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:16.978274 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4eafce7a-628d-4db3-8a41-469a4d5dcf19 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:16.978968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4eafce7a-628d-4db3-8a41-469a4d5dcf19 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:16.979421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4eafce7a-628d-4db3-8a41-469a4d5dcf19 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:16.979842 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4eafce7a-628d-4db3-8a41-469a4d5dcf19 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:17.056088 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d254b191-6ff3-4ae0-a1e2-07787cbd71bb tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:17.063775 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d254b191-6ff3-4ae0-a1e2-07787cbd71bb tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.160090 Aug 19 16:33:17.064334 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 125/251] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:16 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:17.108603 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-4eafce7a-628d-4db3-8a41-469a4d5dcf19 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:17.117633 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4eafce7a-628d-4db3-8a41-469a4d5dcf19 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1555 microversion: 2.1 time: 0.150544 Aug 19 16:33:17.118233 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 127/252] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:16 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:17.961294 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-48d5ff16-36bb-4eaf-9792-5891e9901c55 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:17.962051 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-48d5ff16-36bb-4eaf-9792-5891e9901c55 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:17.968368 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-48d5ff16-36bb-4eaf-9792-5891e9901c55 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:17.968882 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-48d5ff16-36bb-4eaf-9792-5891e9901c55 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:17.969315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-48d5ff16-36bb-4eaf-9792-5891e9901c55 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:17.969997 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-48d5ff16-36bb-4eaf-9792-5891e9901c55 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:17.970448 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-48d5ff16-36bb-4eaf-9792-5891e9901c55 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:17.970871 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-48d5ff16-36bb-4eaf-9792-5891e9901c55 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:18.085284 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-fabf19c7-c85a-4dcf-b4de-e4111ceb3a1f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:18.086666 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-fabf19c7-c85a-4dcf-b4de-e4111ceb3a1f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:18.092538 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fabf19c7-c85a-4dcf-b4de-e4111ceb3a1f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:18.093047 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fabf19c7-c85a-4dcf-b4de-e4111ceb3a1f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:18.093472 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fabf19c7-c85a-4dcf-b4de-e4111ceb3a1f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:18.094158 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fabf19c7-c85a-4dcf-b4de-e4111ceb3a1f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:18.094605 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fabf19c7-c85a-4dcf-b4de-e4111ceb3a1f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:18.095020 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fabf19c7-c85a-4dcf-b4de-e4111ceb3a1f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:18.102609 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-48d5ff16-36bb-4eaf-9792-5891e9901c55 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:18.110082 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-48d5ff16-36bb-4eaf-9792-5891e9901c55 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.153475 Aug 19 16:33:18.110641 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 126/253] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:17 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:18.138831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-53018627-af0c-4cc8-9170-f68b865762ba tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:18.139338 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-53018627-af0c-4cc8-9170-f68b865762ba tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:18.145136 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53018627-af0c-4cc8-9170-f68b865762ba tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:18.145611 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53018627-af0c-4cc8-9170-f68b865762ba tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:18.146040 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53018627-af0c-4cc8-9170-f68b865762ba tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:18.146718 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53018627-af0c-4cc8-9170-f68b865762ba tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:18.147162 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53018627-af0c-4cc8-9170-f68b865762ba tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:18.147580 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53018627-af0c-4cc8-9170-f68b865762ba tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:18.230094 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fabf19c7-c85a-4dcf-b4de-e4111ceb3a1f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:18.237606 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-fabf19c7-c85a-4dcf-b4de-e4111ceb3a1f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.156401 Aug 19 16:33:18.238163 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 128/254] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:18 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:18.277695 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-53018627-af0c-4cc8-9170-f68b865762ba tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:18.285912 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-53018627-af0c-4cc8-9170-f68b865762ba tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1555 microversion: 2.1 time: 0.150994 Aug 19 16:33:18.286479 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 127/255] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:18 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:19.130724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0113aef4-2021-4a86-a4ea-66f1b3eea74d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:19.131324 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-0113aef4-2021-4a86-a4ea-66f1b3eea74d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:19.137225 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0113aef4-2021-4a86-a4ea-66f1b3eea74d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:19.137701 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0113aef4-2021-4a86-a4ea-66f1b3eea74d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:19.138132 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0113aef4-2021-4a86-a4ea-66f1b3eea74d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:19.138806 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0113aef4-2021-4a86-a4ea-66f1b3eea74d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:19.139252 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0113aef4-2021-4a86-a4ea-66f1b3eea74d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:19.139673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0113aef4-2021-4a86-a4ea-66f1b3eea74d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:19.258081 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-349b9284-9be5-40de-bc06-21a282f59745 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:19.258684 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-349b9284-9be5-40de-bc06-21a282f59745 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:19.265176 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-349b9284-9be5-40de-bc06-21a282f59745 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:19.265516 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-349b9284-9be5-40de-bc06-21a282f59745 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:19.265949 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-349b9284-9be5-40de-bc06-21a282f59745 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:19.266630 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-349b9284-9be5-40de-bc06-21a282f59745 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:19.267082 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-349b9284-9be5-40de-bc06-21a282f59745 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:19.267488 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-349b9284-9be5-40de-bc06-21a282f59745 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:19.267580 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-0113aef4-2021-4a86-a4ea-66f1b3eea74d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:19.275913 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-0113aef4-2021-4a86-a4ea-66f1b3eea74d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.148924 Aug 19 16:33:19.276484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 129/256] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:19 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:19.306671 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c99bc37e-68dd-4049-bfd9-339d5c5a616b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:19.307410 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c99bc37e-68dd-4049-bfd9-339d5c5a616b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:19.313265 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c99bc37e-68dd-4049-bfd9-339d5c5a616b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:19.313735 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c99bc37e-68dd-4049-bfd9-339d5c5a616b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:19.314159 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c99bc37e-68dd-4049-bfd9-339d5c5a616b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:19.314840 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c99bc37e-68dd-4049-bfd9-339d5c5a616b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:19.315284 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c99bc37e-68dd-4049-bfd9-339d5c5a616b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:19.315697 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c99bc37e-68dd-4049-bfd9-339d5c5a616b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:19.333132 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:33:19.402443 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-349b9284-9be5-40de-bc06-21a282f59745 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:19.410134 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-349b9284-9be5-40de-bc06-21a282f59745 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.155931 Aug 19 16:33:19.410708 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 128/257] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:19 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:19.645952 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c99bc37e-68dd-4049-bfd9-339d5c5a616b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:19.654745 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c99bc37e-68dd-4049-bfd9-339d5c5a616b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1555 microversion: 2.1 time: 0.351836 Aug 19 16:33:19.655309 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 130/258] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:19 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1555 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:20.297646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-72b996de-e595-4663-90e3-725924cbb88f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:20.298251 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-72b996de-e595-4663-90e3-725924cbb88f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:20.305223 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-72b996de-e595-4663-90e3-725924cbb88f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:20.305690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-72b996de-e595-4663-90e3-725924cbb88f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:20.306119 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-72b996de-e595-4663-90e3-725924cbb88f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:20.306794 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-72b996de-e595-4663-90e3-725924cbb88f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:20.307241 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-72b996de-e595-4663-90e3-725924cbb88f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:20.307656 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-72b996de-e595-4663-90e3-725924cbb88f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:20.432301 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3a1d077d-6107-4b51-8e7b-965c23ba519f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:20.432955 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-3a1d077d-6107-4b51-8e7b-965c23ba519f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:20.437015 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-72b996de-e595-4663-90e3-725924cbb88f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:20.439028 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3a1d077d-6107-4b51-8e7b-965c23ba519f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:20.439391 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3a1d077d-6107-4b51-8e7b-965c23ba519f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:20.439830 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3a1d077d-6107-4b51-8e7b-965c23ba519f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:20.440532 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3a1d077d-6107-4b51-8e7b-965c23ba519f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:20.441032 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3a1d077d-6107-4b51-8e7b-965c23ba519f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:20.441447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3a1d077d-6107-4b51-8e7b-965c23ba519f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:20.444725 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-72b996de-e595-4663-90e3-725924cbb88f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.150914 Aug 19 16:33:20.445788 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 129/259] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:20 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:20.576577 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-3a1d077d-6107-4b51-8e7b-965c23ba519f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:20.585978 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3a1d077d-6107-4b51-8e7b-965c23ba519f tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1312 microversion: 2.1 time: 0.157920 Aug 19 16:33:20.586553 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 131/260] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:20 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:20.675339 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-dcb31af4-2083-4860-9d6a-86402dabe1fa tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:20.675947 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-dcb31af4-2083-4860-9d6a-86402dabe1fa tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:20.682458 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dcb31af4-2083-4860-9d6a-86402dabe1fa tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:20.682938 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dcb31af4-2083-4860-9d6a-86402dabe1fa tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:20.683372 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dcb31af4-2083-4860-9d6a-86402dabe1fa tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:20.684053 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dcb31af4-2083-4860-9d6a-86402dabe1fa tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:20.684501 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dcb31af4-2083-4860-9d6a-86402dabe1fa tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:20.684957 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dcb31af4-2083-4860-9d6a-86402dabe1fa tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:20.810785 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-dcb31af4-2083-4860-9d6a-86402dabe1fa tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:20.819092 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-dcb31af4-2083-4860-9d6a-86402dabe1fa tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1555 microversion: 2.1 time: 0.147627 Aug 19 16:33:20.820349 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 130/261] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:20 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:21.466198 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2fe32742-d27c-40c8-b16d-3e5c313156c3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:21.466853 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2fe32742-d27c-40c8-b16d-3e5c313156c3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:21.473457 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2fe32742-d27c-40c8-b16d-3e5c313156c3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:21.473941 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2fe32742-d27c-40c8-b16d-3e5c313156c3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:21.474367 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2fe32742-d27c-40c8-b16d-3e5c313156c3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:21.475308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2fe32742-d27c-40c8-b16d-3e5c313156c3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:21.476642 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2fe32742-d27c-40c8-b16d-3e5c313156c3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:21.477187 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2fe32742-d27c-40c8-b16d-3e5c313156c3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:21.608015 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-3887c3ab-de9d-4e23-b612-47ca06eeadb2 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:21.608797 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-3887c3ab-de9d-4e23-b612-47ca06eeadb2 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:21.617090 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2fe32742-d27c-40c8-b16d-3e5c313156c3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:21.621681 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3887c3ab-de9d-4e23-b612-47ca06eeadb2 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:21.622172 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3887c3ab-de9d-4e23-b612-47ca06eeadb2 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:21.622606 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3887c3ab-de9d-4e23-b612-47ca06eeadb2 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:21.623303 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3887c3ab-de9d-4e23-b612-47ca06eeadb2 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:21.623751 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3887c3ab-de9d-4e23-b612-47ca06eeadb2 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:21.624180 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3887c3ab-de9d-4e23-b612-47ca06eeadb2 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:21.635436 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2fe32742-d27c-40c8-b16d-3e5c313156c3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.172955 Aug 19 16:33:21.636008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 132/262] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:21 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:21.772305 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-3887c3ab-de9d-4e23-b612-47ca06eeadb2 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:21.780956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-3887c3ab-de9d-4e23-b612-47ca06eeadb2 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1497 microversion: 2.1 time: 0.177810 Aug 19 16:33:21.781563 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 131/263] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:21 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:21.841586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b79f25e0-afdc-4cca-b9f6-3d048b7379f6 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:21.842199 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b79f25e0-afdc-4cca-b9f6-3d048b7379f6 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:21.847951 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b79f25e0-afdc-4cca-b9f6-3d048b7379f6 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:21.848436 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b79f25e0-afdc-4cca-b9f6-3d048b7379f6 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:21.848907 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b79f25e0-afdc-4cca-b9f6-3d048b7379f6 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:21.849598 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b79f25e0-afdc-4cca-b9f6-3d048b7379f6 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:21.850053 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b79f25e0-afdc-4cca-b9f6-3d048b7379f6 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:21.850477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b79f25e0-afdc-4cca-b9f6-3d048b7379f6 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:21.976208 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b79f25e0-afdc-4cca-b9f6-3d048b7379f6 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:21.984454 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b79f25e0-afdc-4cca-b9f6-3d048b7379f6 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1555 microversion: 2.1 time: 0.146691 Aug 19 16:33:21.985052 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 133/264] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:21 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:22.657434 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-67259799-2053-4701-bbf5-3fe9af80c66a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:22.658045 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-67259799-2053-4701-bbf5-3fe9af80c66a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:22.665251 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-67259799-2053-4701-bbf5-3fe9af80c66a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:22.665733 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-67259799-2053-4701-bbf5-3fe9af80c66a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:22.666169 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-67259799-2053-4701-bbf5-3fe9af80c66a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:22.666858 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-67259799-2053-4701-bbf5-3fe9af80c66a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:22.667311 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-67259799-2053-4701-bbf5-3fe9af80c66a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:22.667733 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-67259799-2053-4701-bbf5-3fe9af80c66a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:22.796961 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-67259799-2053-4701-bbf5-3fe9af80c66a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:22.804794 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-67259799-2053-4701-bbf5-3fe9af80c66a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.151196 Aug 19 16:33:22.805287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 132/265] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:22 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:23.005417 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-fdf170a8-eb6a-41be-8792-ed19db3034e2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:23.006018 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-fdf170a8-eb6a-41be-8792-ed19db3034e2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:23.011906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fdf170a8-eb6a-41be-8792-ed19db3034e2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:23.012380 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fdf170a8-eb6a-41be-8792-ed19db3034e2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:23.012839 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fdf170a8-eb6a-41be-8792-ed19db3034e2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:23.013515 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fdf170a8-eb6a-41be-8792-ed19db3034e2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:23.013960 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fdf170a8-eb6a-41be-8792-ed19db3034e2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:23.014376 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fdf170a8-eb6a-41be-8792-ed19db3034e2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:23.139395 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fdf170a8-eb6a-41be-8792-ed19db3034e2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:23.147385 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-fdf170a8-eb6a-41be-8792-ed19db3034e2 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1555 microversion: 2.1 time: 0.145819 Aug 19 16:33:23.148461 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 134/266] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:23 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:23.825845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f0c8d2c6-7256-4db5-884a-81670e1ba363 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:23.826490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f0c8d2c6-7256-4db5-884a-81670e1ba363 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:23.832856 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f0c8d2c6-7256-4db5-884a-81670e1ba363 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:23.833591 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f0c8d2c6-7256-4db5-884a-81670e1ba363 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:23.834024 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f0c8d2c6-7256-4db5-884a-81670e1ba363 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:23.834710 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f0c8d2c6-7256-4db5-884a-81670e1ba363 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:23.835237 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f0c8d2c6-7256-4db5-884a-81670e1ba363 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:23.835657 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f0c8d2c6-7256-4db5-884a-81670e1ba363 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:23.963901 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f0c8d2c6-7256-4db5-884a-81670e1ba363 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:23.971416 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f0c8d2c6-7256-4db5-884a-81670e1ba363 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.149356 Aug 19 16:33:23.971972 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 133/267] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:23 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:24.169571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b5b2fd79-6631-4a7b-9011-a3bfed2be128 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:24.170096 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b5b2fd79-6631-4a7b-9011-a3bfed2be128 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:24.175914 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b5b2fd79-6631-4a7b-9011-a3bfed2be128 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:24.176386 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b5b2fd79-6631-4a7b-9011-a3bfed2be128 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:24.176842 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b5b2fd79-6631-4a7b-9011-a3bfed2be128 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:24.177522 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b5b2fd79-6631-4a7b-9011-a3bfed2be128 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:24.177964 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b5b2fd79-6631-4a7b-9011-a3bfed2be128 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:24.178380 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b5b2fd79-6631-4a7b-9011-a3bfed2be128 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:24.307565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b5b2fd79-6631-4a7b-9011-a3bfed2be128 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:24.315618 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b5b2fd79-6631-4a7b-9011-a3bfed2be128 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1555 microversion: 2.1 time: 0.149903 Aug 19 16:33:24.316179 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 135/268] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:24 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:24.992625 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8f093ed6-7e33-4b4b-806d-72dee5d67c22 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:24.993267 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8f093ed6-7e33-4b4b-806d-72dee5d67c22 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:24.999615 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f093ed6-7e33-4b4b-806d-72dee5d67c22 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:25.000118 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f093ed6-7e33-4b4b-806d-72dee5d67c22 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:25.000546 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f093ed6-7e33-4b4b-806d-72dee5d67c22 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:25.001247 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f093ed6-7e33-4b4b-806d-72dee5d67c22 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:25.001694 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f093ed6-7e33-4b4b-806d-72dee5d67c22 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:25.002114 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f093ed6-7e33-4b4b-806d-72dee5d67c22 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:25.019672 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=100 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:33:25.133822 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8f093ed6-7e33-4b4b-806d-72dee5d67c22 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:25.141300 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8f093ed6-7e33-4b4b-806d-72dee5d67c22 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.152488 Aug 19 16:33:25.141857 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 134/269] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:24 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:25.336593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-968cb431-3783-4c6f-8930-d3566649808a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:25.337269 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-968cb431-3783-4c6f-8930-d3566649808a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:25.343221 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-968cb431-3783-4c6f-8930-d3566649808a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:25.343697 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-968cb431-3783-4c6f-8930-d3566649808a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:25.344128 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-968cb431-3783-4c6f-8930-d3566649808a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:25.344838 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-968cb431-3783-4c6f-8930-d3566649808a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:25.345288 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-968cb431-3783-4c6f-8930-d3566649808a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:25.345706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-968cb431-3783-4c6f-8930-d3566649808a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:25.479124 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-968cb431-3783-4c6f-8930-d3566649808a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:25.488505 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-968cb431-3783-4c6f-8930-d3566649808a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1555 microversion: 2.1 time: 0.156079 Aug 19 16:33:25.489101 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 136/270] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:25 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:26.162307 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f64cb2a7-64c3-4314-bf3e-a459c1e307a8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:26.162944 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f64cb2a7-64c3-4314-bf3e-a459c1e307a8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:26.169570 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f64cb2a7-64c3-4314-bf3e-a459c1e307a8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:26.170053 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f64cb2a7-64c3-4314-bf3e-a459c1e307a8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:26.170485 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f64cb2a7-64c3-4314-bf3e-a459c1e307a8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:26.171162 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f64cb2a7-64c3-4314-bf3e-a459c1e307a8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:26.171615 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f64cb2a7-64c3-4314-bf3e-a459c1e307a8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:26.172037 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f64cb2a7-64c3-4314-bf3e-a459c1e307a8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:26.305768 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f64cb2a7-64c3-4314-bf3e-a459c1e307a8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:26.313569 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f64cb2a7-64c3-4314-bf3e-a459c1e307a8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.155539 Aug 19 16:33:26.315493 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 135/271] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:26 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:26.378891 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e15b16fb-558c-4a63-b1f3-f33b6d47c7b1 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:26.379387 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e15b16fb-558c-4a63-b1f3-f33b6d47c7b1 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:26.386827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e15b16fb-558c-4a63-b1f3-f33b6d47c7b1 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:26.387555 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e15b16fb-558c-4a63-b1f3-f33b6d47c7b1 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:26.388257 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e15b16fb-558c-4a63-b1f3-f33b6d47c7b1 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:26.389014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e15b16fb-558c-4a63-b1f3-f33b6d47c7b1 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:26.389497 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e15b16fb-558c-4a63-b1f3-f33b6d47c7b1 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:26.389987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e15b16fb-558c-4a63-b1f3-f33b6d47c7b1 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:26.416475 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e15b16fb-558c-4a63-b1f3-f33b6d47c7b1 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Going to try to terminate instance {{(pid=127285) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:33:26.510471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-24e71ac4-09c5-4556-af4f-7b1420e7102b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:26.511339 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-24e71ac4-09c5-4556-af4f-7b1420e7102b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:26.515085 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e15b16fb-558c-4a63-b1f3-f33b6d47c7b1 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 204 len: 0 microversion: 2.1 time: 0.139710 Aug 19 16:33:26.515666 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 137/272] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:33:26 2022] DELETE /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:33:26.522163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-24e71ac4-09c5-4556-af4f-7b1420e7102b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:26.523273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-24e71ac4-09c5-4556-af4f-7b1420e7102b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:26.524027 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-24e71ac4-09c5-4556-af4f-7b1420e7102b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:26.527397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4f988a7a-d135-4fb5-8716-f7a03791025d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:26.529022 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-4f988a7a-d135-4fb5-8716-f7a03791025d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:26.536808 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-24e71ac4-09c5-4556-af4f-7b1420e7102b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:26.537314 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-24e71ac4-09c5-4556-af4f-7b1420e7102b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:26.537553 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4f988a7a-d135-4fb5-8716-f7a03791025d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:26.538400 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-24e71ac4-09c5-4556-af4f-7b1420e7102b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:26.538504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4f988a7a-d135-4fb5-8716-f7a03791025d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:26.539029 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4f988a7a-d135-4fb5-8716-f7a03791025d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:26.539861 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4f988a7a-d135-4fb5-8716-f7a03791025d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:26.540577 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4f988a7a-d135-4fb5-8716-f7a03791025d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:26.541821 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4f988a7a-d135-4fb5-8716-f7a03791025d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:26.715289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-24e71ac4-09c5-4556-af4f-7b1420e7102b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:26.725259 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-24e71ac4-09c5-4556-af4f-7b1420e7102b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1555 microversion: 2.1 time: 0.219051 Aug 19 16:33:26.726273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 136/273] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:26 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1555 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:26.750346 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-4f988a7a-d135-4fb5-8716-f7a03791025d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:26.759571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4f988a7a-d135-4fb5-8716-f7a03791025d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1503 microversion: 2.1 time: 0.239281 Aug 19 16:33:26.760070 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 138/274] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:26 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1503 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:26.946666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-2e4279a4-fee9-4424-b289-86aff18ba76c req-b831ae53-6adc-43e6-b49b-661c7af75073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d89321-9f57-4555-b081-9aacd51fba08", "name": "network-vif-deleted", "tag": "c546c8c9-4520-43bf-97d3-35760918599b"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:33:26.962270 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-2e4279a4-fee9-4424-b289-86aff18ba76c req-b831ae53-6adc-43e6-b49b-661c7af75073 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:26.962808 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-2e4279a4-fee9-4424-b289-86aff18ba76c req-b831ae53-6adc-43e6-b49b-661c7af75073 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:26.963669 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-2e4279a4-fee9-4424-b289-86aff18ba76c req-b831ae53-6adc-43e6-b49b-661c7af75073 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:26.976396 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-2e4279a4-fee9-4424-b289-86aff18ba76c req-b831ae53-6adc-43e6-b49b-661c7af75073 service nova] Creating event network-vif-deleted:c546c8c9-4520-43bf-97d3-35760918599b for instance 33d89321-9f57-4555-b081-9aacd51fba08 on hv-cinder-83124 Aug 19 16:33:26.981885 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-2e4279a4-fee9-4424-b289-86aff18ba76c req-b831ae53-6adc-43e6-b49b-661c7af75073 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038971 Aug 19 16:33:26.986064 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 137/275] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:33:27.336428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8331ca87-b056-45ae-9f76-5cb91bd7b261 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:27.337063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8331ca87-b056-45ae-9f76-5cb91bd7b261 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:27.343109 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8331ca87-b056-45ae-9f76-5cb91bd7b261 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:27.343598 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8331ca87-b056-45ae-9f76-5cb91bd7b261 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:27.344027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8331ca87-b056-45ae-9f76-5cb91bd7b261 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:27.344710 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8331ca87-b056-45ae-9f76-5cb91bd7b261 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:27.345185 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8331ca87-b056-45ae-9f76-5cb91bd7b261 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:27.345615 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8331ca87-b056-45ae-9f76-5cb91bd7b261 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:27.480663 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-8331ca87-b056-45ae-9f76-5cb91bd7b261 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:27.488240 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8331ca87-b056-45ae-9f76-5cb91bd7b261 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.156694 Aug 19 16:33:27.488808 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 139/276] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:27 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:27.750262 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ade3e408-c18b-4ffb-b2eb-070683d7cd7a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:27.751210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ade3e408-c18b-4ffb-b2eb-070683d7cd7a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:27.759107 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ade3e408-c18b-4ffb-b2eb-070683d7cd7a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:27.759107 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ade3e408-c18b-4ffb-b2eb-070683d7cd7a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:27.759376 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ade3e408-c18b-4ffb-b2eb-070683d7cd7a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:27.760100 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ade3e408-c18b-4ffb-b2eb-070683d7cd7a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:27.760547 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ade3e408-c18b-4ffb-b2eb-070683d7cd7a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:27.760995 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ade3e408-c18b-4ffb-b2eb-070683d7cd7a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:27.780828 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-9dc6c06a-9883-40df-90d3-1b319f64382c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:27.781655 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-9dc6c06a-9883-40df-90d3-1b319f64382c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:27.790047 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9dc6c06a-9883-40df-90d3-1b319f64382c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:27.790779 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9dc6c06a-9883-40df-90d3-1b319f64382c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:27.791473 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9dc6c06a-9883-40df-90d3-1b319f64382c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:27.792510 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9dc6c06a-9883-40df-90d3-1b319f64382c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:27.793185 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9dc6c06a-9883-40df-90d3-1b319f64382c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:27.794027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9dc6c06a-9883-40df-90d3-1b319f64382c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:27.848370 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ade3e408-c18b-4ffb-b2eb-070683d7cd7a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:27.859216 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ade3e408-c18b-4ffb-b2eb-070683d7cd7a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1513 microversion: 2.1 time: 0.113128 Aug 19 16:33:27.860801 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 138/277] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:27 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1513 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:27.929086 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-9dc6c06a-9883-40df-90d3-1b319f64382c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:27.936793 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-9dc6c06a-9883-40df-90d3-1b319f64382c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1503 microversion: 2.1 time: 0.159810 Aug 19 16:33:27.937353 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 140/278] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:27 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:28.509979 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-361895c0-2ff0-47f8-a366-bff9a714b1da tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:28.510587 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-361895c0-2ff0-47f8-a366-bff9a714b1da tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:28.516443 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-361895c0-2ff0-47f8-a366-bff9a714b1da tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:28.516957 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-361895c0-2ff0-47f8-a366-bff9a714b1da tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:28.517388 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-361895c0-2ff0-47f8-a366-bff9a714b1da tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:28.518070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-361895c0-2ff0-47f8-a366-bff9a714b1da tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:28.518517 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-361895c0-2ff0-47f8-a366-bff9a714b1da tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:28.519051 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-361895c0-2ff0-47f8-a366-bff9a714b1da tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:28.664141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-361895c0-2ff0-47f8-a366-bff9a714b1da tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:28.672521 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-361895c0-2ff0-47f8-a366-bff9a714b1da tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.166581 Aug 19 16:33:28.673132 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 139/279] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:28 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:28.880239 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1526caae-271f-4683-a16b-2d080696d61b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:28.880886 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-1526caae-271f-4683-a16b-2d080696d61b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:28.886886 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1526caae-271f-4683-a16b-2d080696d61b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:28.887379 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1526caae-271f-4683-a16b-2d080696d61b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:28.887822 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1526caae-271f-4683-a16b-2d080696d61b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:28.888518 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1526caae-271f-4683-a16b-2d080696d61b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:28.889019 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1526caae-271f-4683-a16b-2d080696d61b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:28.889629 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1526caae-271f-4683-a16b-2d080696d61b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:28.955421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1526caae-271f-4683-a16b-2d080696d61b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:28.961866 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ca0aa2ef-85c9-4930-aa53-4707c8afcddd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:28.963174 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ca0aa2ef-85c9-4930-aa53-4707c8afcddd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:28.966923 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-1526caae-271f-4683-a16b-2d080696d61b tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1346 microversion: 2.1 time: 0.088150 Aug 19 16:33:28.966923 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 141/280] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:28 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:28.972930 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ca0aa2ef-85c9-4930-aa53-4707c8afcddd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:28.973412 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ca0aa2ef-85c9-4930-aa53-4707c8afcddd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:28.973841 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ca0aa2ef-85c9-4930-aa53-4707c8afcddd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:28.974712 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ca0aa2ef-85c9-4930-aa53-4707c8afcddd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:28.976399 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ca0aa2ef-85c9-4930-aa53-4707c8afcddd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:28.976851 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ca0aa2ef-85c9-4930-aa53-4707c8afcddd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:29.109628 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ca0aa2ef-85c9-4930-aa53-4707c8afcddd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:29.118260 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ca0aa2ef-85c9-4930-aa53-4707c8afcddd tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1503 microversion: 2.1 time: 0.162783 Aug 19 16:33:29.119163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 140/281] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:28 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:29.703307 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d605f206-17ab-4db4-8f15-ad2864690a1f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:29.704036 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d605f206-17ab-4db4-8f15-ad2864690a1f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:29.714850 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d605f206-17ab-4db4-8f15-ad2864690a1f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:29.715446 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d605f206-17ab-4db4-8f15-ad2864690a1f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:29.715970 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d605f206-17ab-4db4-8f15-ad2864690a1f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:29.718502 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d605f206-17ab-4db4-8f15-ad2864690a1f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:29.719276 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d605f206-17ab-4db4-8f15-ad2864690a1f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:29.719896 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d605f206-17ab-4db4-8f15-ad2864690a1f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:29.931620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d605f206-17ab-4db4-8f15-ad2864690a1f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:29.939670 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d605f206-17ab-4db4-8f15-ad2864690a1f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.248197 Aug 19 16:33:29.940636 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 142/282] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:29 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:29.985552 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-9439aa1e-dbb1-4333-9628-36e4e1dfc30c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:29.986764 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-9439aa1e-dbb1-4333-9628-36e4e1dfc30c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:29.994726 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9439aa1e-dbb1-4333-9628-36e4e1dfc30c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:29.995226 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9439aa1e-dbb1-4333-9628-36e4e1dfc30c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:29.995700 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9439aa1e-dbb1-4333-9628-36e4e1dfc30c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:29.996483 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9439aa1e-dbb1-4333-9628-36e4e1dfc30c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:29.997135 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9439aa1e-dbb1-4333-9628-36e4e1dfc30c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:29.997861 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9439aa1e-dbb1-4333-9628-36e4e1dfc30c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:30.037574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9439aa1e-dbb1-4333-9628-36e4e1dfc30c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:30.038105 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9439aa1e-dbb1-4333-9628-36e4e1dfc30c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:30.038539 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9439aa1e-dbb1-4333-9628-36e4e1dfc30c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:30.039884 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.objects.instance [None req-9439aa1e-dbb1-4333-9628-36e4e1dfc30c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lazy-loading 'fault' on Instance uuid 33d89321-9f57-4555-b081-9aacd51fba08 {{(pid=127284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:33:30.091626 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-98714b7d-edb2-4e90-9250-94e461c63f06 req-e2c20467-7d6b-4d91-81a4-151bf1742a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65a2b34-93a3-4706-8976-168dd7a63b2f", "name": "network-vif-deleted", "tag": "34bb549a-511d-4a52-b403-c677e27dd664"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:33:30.098306 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-9439aa1e-dbb1-4333-9628-36e4e1dfc30c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d20b306fc68435baa0da6f09c915157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4516d3cd63d4d89824c4a0b20b6eea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:30.103684 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-98714b7d-edb2-4e90-9250-94e461c63f06 req-e2c20467-7d6b-4d91-81a4-151bf1742a74 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:30.104235 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-98714b7d-edb2-4e90-9250-94e461c63f06 req-e2c20467-7d6b-4d91-81a4-151bf1742a74 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:30.104910 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-98714b7d-edb2-4e90-9250-94e461c63f06 req-e2c20467-7d6b-4d91-81a4-151bf1742a74 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:30.106836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-9439aa1e-dbb1-4333-9628-36e4e1dfc30c tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 200 len: 1351 microversion: 2.1 time: 0.125031 Aug 19 16:33:30.107403 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 141/283] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:29 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 1351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:30.116391 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-98714b7d-edb2-4e90-9250-94e461c63f06 req-e2c20467-7d6b-4d91-81a4-151bf1742a74 service nova] Creating event network-vif-deleted:34bb549a-511d-4a52-b403-c677e27dd664 for instance e65a2b34-93a3-4706-8976-168dd7a63b2f on hv-cinder-83124 Aug 19 16:33:30.121600 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-98714b7d-edb2-4e90-9250-94e461c63f06 req-e2c20467-7d6b-4d91-81a4-151bf1742a74 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034742 Aug 19 16:33:30.122263 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 143/284] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:33:30.139037 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f33124a7-996f-431a-9d57-6afaff1588df tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:30.139685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f33124a7-996f-431a-9d57-6afaff1588df tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:30.145768 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f33124a7-996f-431a-9d57-6afaff1588df tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:30.146481 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f33124a7-996f-431a-9d57-6afaff1588df tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:30.147010 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f33124a7-996f-431a-9d57-6afaff1588df tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:30.148495 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f33124a7-996f-431a-9d57-6afaff1588df tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:30.149148 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f33124a7-996f-431a-9d57-6afaff1588df tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:30.149756 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f33124a7-996f-431a-9d57-6afaff1588df tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:30.215873 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f33124a7-996f-431a-9d57-6afaff1588df tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:30.223834 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f33124a7-996f-431a-9d57-6afaff1588df tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 200 len: 1461 microversion: 2.1 time: 0.089029 Aug 19 16:33:30.237048 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 142/285] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:30 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 1461 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:30.963285 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-7a323b79-4b77-48aa-9731-eb7e59014b58 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:30.964063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-7a323b79-4b77-48aa-9731-eb7e59014b58 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:30.970411 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7a323b79-4b77-48aa-9731-eb7e59014b58 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:30.971301 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7a323b79-4b77-48aa-9731-eb7e59014b58 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:30.971907 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7a323b79-4b77-48aa-9731-eb7e59014b58 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:30.972810 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7a323b79-4b77-48aa-9731-eb7e59014b58 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:30.973414 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7a323b79-4b77-48aa-9731-eb7e59014b58 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:30.974156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7a323b79-4b77-48aa-9731-eb7e59014b58 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:31.128043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2e6ae047-0292-4032-bb42-e07bb4a1c79a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:31.128662 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2e6ae047-0292-4032-bb42-e07bb4a1c79a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:31.129531 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7a323b79-4b77-48aa-9731-eb7e59014b58 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:31.135142 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2e6ae047-0292-4032-bb42-e07bb4a1c79a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:31.135635 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2e6ae047-0292-4032-bb42-e07bb4a1c79a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:31.136257 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2e6ae047-0292-4032-bb42-e07bb4a1c79a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:31.136998 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2e6ae047-0292-4032-bb42-e07bb4a1c79a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:31.137459 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2e6ae047-0292-4032-bb42-e07bb4a1c79a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:31.137892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2e6ae047-0292-4032-bb42-e07bb4a1c79a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:31.139080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-7a323b79-4b77-48aa-9731-eb7e59014b58 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.180591 Aug 19 16:33:31.139850 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 144/286] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:30 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:31.152800 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-2e6ae047-0292-4032-bb42-e07bb4a1c79a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] HTTP exception thrown: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2e6ae047-0292-4032-bb42-e07bb4a1c79a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Request method failure captured: Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 HTTP/1.1 Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7sI7hLZHmJT4OOUC7NIrM2gO9lSTWxNJXgAxrAHI3T5nz_yFQAxgM7HfJ_1s_kNnhkka2-mx5AP_lNTeyWwF23jeiQiNujCUscDHLc0sKJVM7Xc9xYHf8TWHvDOPDMTe-Dtcbx-ln8SUa5_aM9uAAAoow709oaRlOUX6pkeOk-pjEs Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: b4516d3cd63d4d89824c4a0b20b6eea1 Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-DeleteServersTestJSON-1866216478 Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:33:31.158771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:33:31.160371 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b4516d3cd63d4d89824c4a0b20b6eea1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4516d3cd63d4d89824c4a0b20b6eea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4516d3cd63d4d89824c4a0b20b6eea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b4516d3cd63d4d89824c4a0b20b6eea1"}]}] Aug 19 16:33:31.160371 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-DeleteServersTestJSON-1866216478 Aug 19 16:33:31.160371 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: b4516d3cd63d4d89824c4a0b20b6eea1 Aug 19 16:33:31.160371 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-DeleteServersTestJSON-1866216478 Aug 19 16:33:31.160371 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-DeleteServersTestJSON-1866216478-project Aug 19 16:33:31.160371 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:33:31.160371 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:33:31.160371 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: 8d20b306fc68435baa0da6f09c915157 Aug 19 16:33:31.160371 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-DeleteServersTestJSON-1866216478-project Aug 19 16:33:31.160371 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:33:31.160371 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. Aug 19 16:33:31.160371 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': '33d89321-9f57-4555-b081-9aacd51fba08'} Aug 19 16:33:31.161246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:33:31.161246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:31.161246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:33:31.161246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:33:31.161246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:33:31.161246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:33:31.161246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:33:31.161246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:33:31.161246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:33:31.161246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:33:31.161246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. Aug 19 16:33:31.161246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:31.161246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:33:31.161246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:31.161246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:31.161246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:33:31.161246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:33:31.161246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:33:31.161246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:33:31.161246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:33:31.163836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:33:31.163836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:33:31.163836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:33:31.163836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:33:31.163836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:33:31.163836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:33:31.163836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:33:31.163836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. Aug 19 16:33:31.163836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:31.163836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:33:31.163836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:31.163836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:31.163836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:33:31.163836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:33:31.163836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:33:31.163836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:33:31.163836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. Aug 19 16:33:31.163836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:31.165870 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2e6ae047-0292-4032-bb42-e07bb4a1c79a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Returning 404 to user: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:33:31.165870 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2e6ae047-0292-4032-bb42-e07bb4a1c79a tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 404 len: 111 microversion: 2.1 time: 0.036356 Aug 19 16:33:31.165870 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 143/287] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:31 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 16:33:31.246668 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a3a59f09-613b-4b3a-8a17-7fdf098f1226 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:31.247275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a3a59f09-613b-4b3a-8a17-7fdf098f1226 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: e65a2b34-93a3-4706-8976-168dd7a63b2f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:31.253507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a3a59f09-613b-4b3a-8a17-7fdf098f1226 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:31.253986 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a3a59f09-613b-4b3a-8a17-7fdf098f1226 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:31.254412 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a3a59f09-613b-4b3a-8a17-7fdf098f1226 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:31.255169 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a3a59f09-613b-4b3a-8a17-7fdf098f1226 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:31.255614 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a3a59f09-613b-4b3a-8a17-7fdf098f1226 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:31.256191 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a3a59f09-613b-4b3a-8a17-7fdf098f1226 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:31.270062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-a3a59f09-613b-4b3a-8a17-7fdf098f1226 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] HTTP exception thrown: Instance e65a2b34-93a3-4706-8976-168dd7a63b2f could not be found. Aug 19 16:33:31.275821 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-393f00d1-40a7-467b-9d1f-997fff79b0e7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a3a59f09-613b-4b3a-8a17-7fdf098f1226 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Request method failure captured: Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f HTTP/1.1 Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7sposr7f5KUP_1-dMGsybC4dHG7F-QwF0LZrHj_JoanU8M2NIKbxrSitLzzkrnFRrjDqC0IVHiKZPP9trQqyWfuGORUQkKRkdzACF-fdn04UMJZZHQyzE5z44092YBXOohl9jq8i8tXE8krhQ7CeHDzQJOHIXZrb81yJGOW6BXZqcY Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: a549f3d5fb9443409faa06cf7b00d8ca Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-VolumesActionsTest-736109715 Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:33:31.276136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:33:31.277651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a549f3d5fb9443409faa06cf7b00d8ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a549f3d5fb9443409faa06cf7b00d8ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a549f3d5fb9443409faa06cf7b00d8ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a549f3d5fb9443409faa06cf7b00d8ca"}]}] Aug 19 16:33:31.277651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-VolumesActionsTest-736109715 Aug 19 16:33:31.277651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: a549f3d5fb9443409faa06cf7b00d8ca Aug 19 16:33:31.277651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-VolumesActionsTest-736109715 Aug 19 16:33:31.277651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-VolumesActionsTest-736109715-project Aug 19 16:33:31.277651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:33:31.277651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:33:31.277651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: 7536a92033384383bd625b6c969ebd38 Aug 19 16:33:31.277651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-VolumesActionsTest-736109715-project Aug 19 16:33:31.277651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:33:31.277651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance e65a2b34-93a3-4706-8976-168dd7a63b2f could not be found. Aug 19 16:33:31.277651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': 'e65a2b34-93a3-4706-8976-168dd7a63b2f'} Aug 19 16:33:31.278490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:33:31.278490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:31.278490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:33:31.278490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:33:31.278490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:33:31.278490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:33:31.278490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:33:31.278490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:33:31.278490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:33:31.278490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:33:31.278490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e65a2b34-93a3-4706-8976-168dd7a63b2f could not be found. Aug 19 16:33:31.278490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:33:31.278490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:33:31.278490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:33:31.278490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:31.278490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:33:31.278490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:33:31.278490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:33:31.278490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:33:31.278490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:33:31.279802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:33:31.279802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:33:31.279802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:33:31.279802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:33:31.279802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:33:31.279802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:33:31.279802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:33:31.279802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e65a2b34-93a3-4706-8976-168dd7a63b2f could not be found. Aug 19 16:33:31.279802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:33:31.279802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:33:31.279802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:33:31.279802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:31.279802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:33:31.279802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:33:31.279802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:33:31.279802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:33:31.279802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e65a2b34-93a3-4706-8976-168dd7a63b2f could not be found. Aug 19 16:33:31.279802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:33:31.280972 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a3a59f09-613b-4b3a-8a17-7fdf098f1226 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Returning 404 to user: Instance e65a2b34-93a3-4706-8976-168dd7a63b2f could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:33:31.280972 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a3a59f09-613b-4b3a-8a17-7fdf098f1226 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f" status: 404 len: 111 microversion: 2.1 time: 0.035344 Aug 19 16:33:31.281123 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-393f00d1-40a7-467b-9d1f-997fff79b0e7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:31.281858 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 145/288] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:31 2022] GET /compute/v2.1/servers/e65a2b34-93a3-4706-8976-168dd7a63b2f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:33:31.297127 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-393f00d1-40a7-467b-9d1f-997fff79b0e7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:31.297944 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-393f00d1-40a7-467b-9d1f-997fff79b0e7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:31.298554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-393f00d1-40a7-467b-9d1f-997fff79b0e7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:31.299409 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-393f00d1-40a7-467b-9d1f-997fff79b0e7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:31.300182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-393f00d1-40a7-467b-9d1f-997fff79b0e7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:31.300812 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-393f00d1-40a7-467b-9d1f-997fff79b0e7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:31.317367 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-393f00d1-40a7-467b-9d1f-997fff79b0e7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] HTTP exception thrown: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-393f00d1-40a7-467b-9d1f-997fff79b0e7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Request method failure captured: Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08/os-volume_attachments HTTP/1.1 Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7sI7hLZHmJT4OOUC7NIrM2gO9lSTWxNJXgAxrAHI3T5nz_yFQAxgM7HfJ_1s_kNnhkka2-mx5AP_lNTeyWwF23jeiQiNujCUscDHLc0sKJVM7Xc9xYHf8TWHvDOPDMTe-Dtcbx-ln8SUa5_aM9uAAAoow709oaRlOUX6pkeOk-pjEs Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: b4516d3cd63d4d89824c4a0b20b6eea1 Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-DeleteServersTestJSON-1866216478 Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:33:31.319012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:33:31.320937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b4516d3cd63d4d89824c4a0b20b6eea1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4516d3cd63d4d89824c4a0b20b6eea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4516d3cd63d4d89824c4a0b20b6eea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b4516d3cd63d4d89824c4a0b20b6eea1"}]}] Aug 19 16:33:31.320937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-DeleteServersTestJSON-1866216478 Aug 19 16:33:31.320937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: b4516d3cd63d4d89824c4a0b20b6eea1 Aug 19 16:33:31.320937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-DeleteServersTestJSON-1866216478 Aug 19 16:33:31.320937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-DeleteServersTestJSON-1866216478-project Aug 19 16:33:31.320937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:33:31.320937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:33:31.320937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: 8d20b306fc68435baa0da6f09c915157 Aug 19 16:33:31.320937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-DeleteServersTestJSON-1866216478-project Aug 19 16:33:31.320937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:33:31.320937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. Aug 19 16:33:31.320937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'server_id': '33d89321-9f57-4555-b081-9aacd51fba08'} Aug 19 16:33:31.321666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:33:31.321666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:31.321666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:33:31.321666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:33:31.321666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:33:31.321666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:33:31.321666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:33:31.321666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:33:31.321666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:33:31.321666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:33:31.321666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. Aug 19 16:33:31.321666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:31.321666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:33:31.321666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:31.321666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:31.321666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:33:31.321666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:33:31.321666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:33:31.321666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:33:31.321666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:33:31.323345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:33:31.323345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 19 16:33:31.323345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 16:33:31.323345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 19 16:33:31.323345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 16:33:31.323345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 19 16:33:31.323345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 19 16:33:31.323345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:33:31.323345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:33:31.323345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. Aug 19 16:33:31.323345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:31.323345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:33:31.323345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:31.323345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:31.323345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:33:31.323345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:33:31.323345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:33:31.323345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:33:31.323345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. Aug 19 16:33:31.323345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:31.324365 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-393f00d1-40a7-467b-9d1f-997fff79b0e7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Returning 404 to user: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:33:31.324365 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-393f00d1-40a7-467b-9d1f-997fff79b0e7 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.049847 Aug 19 16:33:31.324365 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 144/289] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:33:31 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 16:33:31.414847 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-16c0096c-bb7d-421d-b86a-db86626a399d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-894422977", "imageRef": "da4af7b7-e205-4511-ad99-3478c2523f74", "flavorRef": "452", "networks": [{"uuid": "3b8c4bd2-524b-4747-9fff-40ed56140f3c"}]}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:33:31.477418 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.network.neutron [None req-16c0096c-bb7d-421d-b86a-db86626a399d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] validate_networks() for [('3b8c4bd2-524b-4747-9fff-40ed56140f3c', None, None, None, None, None)] {{(pid=127285) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:33:31.887242 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-16c0096c-bb7d-421d-b86a-db86626a399d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Flavor limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:33:31.887920 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-16c0096c-bb7d-421d-b86a-db86626a399d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Image limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:33:31.888709 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-16c0096c-bb7d-421d-b86a-db86626a399d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Flavor pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:33:31.889173 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-16c0096c-bb7d-421d-b86a-db86626a399d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Image pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:33:31.889783 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-16c0096c-bb7d-421d-b86a-db86626a399d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:33:31.901167 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-16c0096c-bb7d-421d-b86a-db86626a399d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:31.901786 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-16c0096c-bb7d-421d-b86a-db86626a399d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:31.902476 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-16c0096c-bb7d-421d-b86a-db86626a399d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:31.903564 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-16c0096c-bb7d-421d-b86a-db86626a399d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:31.904090 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-16c0096c-bb7d-421d-b86a-db86626a399d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:31.904744 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-16c0096c-bb7d-421d-b86a-db86626a399d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:31.925314 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-16c0096c-bb7d-421d-b86a-db86626a399d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Getting quotas for project a549f3d5fb9443409faa06cf7b00d8ca. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:33:31.930917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-16c0096c-bb7d-421d-b86a-db86626a399d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Getting quotas for user 7536a92033384383bd625b6c969ebd38 and project a549f3d5fb9443409faa06cf7b00d8ca. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:33:31.944584 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-16c0096c-bb7d-421d-b86a-db86626a399d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Going to run 1 instances... {{(pid=127285) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:33:31.947414 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-16c0096c-bb7d-421d-b86a-db86626a399d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='da4af7b7-e205-4511-ad99-3478c2523f74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127285) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:33:32.005912 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-16c0096c-bb7d-421d-b86a-db86626a399d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595593 Aug 19 16:33:32.013033 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 146/290] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Aug 19 16:33:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 16:33:32.018544 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-cb86e41b-2d90-484c-b529-50a8f3e7cf33 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:32.019647 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-cb86e41b-2d90-484c-b529-50a8f3e7cf33 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:32.162014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b4d6c0c7-8471-41ff-ad1a-57c68da71ffd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:32.163763 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b4d6c0c7-8471-41ff-ad1a-57c68da71ffd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:32.173127 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b4d6c0c7-8471-41ff-ad1a-57c68da71ffd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:32.173650 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b4d6c0c7-8471-41ff-ad1a-57c68da71ffd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:32.174296 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b4d6c0c7-8471-41ff-ad1a-57c68da71ffd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:32.175209 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b4d6c0c7-8471-41ff-ad1a-57c68da71ffd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:32.175832 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b4d6c0c7-8471-41ff-ad1a-57c68da71ffd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:32.176445 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b4d6c0c7-8471-41ff-ad1a-57c68da71ffd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:32.219818 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:33:32.263349 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-cb86e41b-2d90-484c-b529-50a8f3e7cf33 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:32.272600 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-cb86e41b-2d90-484c-b529-50a8f3e7cf33 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 200 len: 1213 microversion: 2.1 time: 0.258393 Aug 19 16:33:32.273424 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 145/291] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:32 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 1213 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:32.464544 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b4d6c0c7-8471-41ff-ad1a-57c68da71ffd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:32.472637 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b4d6c0c7-8471-41ff-ad1a-57c68da71ffd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.315419 Aug 19 16:33:32.473453 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 147/292] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:32 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:32.547997 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d41b6cfb-0fb1-4689-aa46-bc8da2d19d9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:32.548837 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d41b6cfb-0fb1-4689-aa46-bc8da2d19d9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:32.556372 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d41b6cfb-0fb1-4689-aa46-bc8da2d19d9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:32.557188 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d41b6cfb-0fb1-4689-aa46-bc8da2d19d9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:32.558122 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d41b6cfb-0fb1-4689-aa46-bc8da2d19d9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:32.559198 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d41b6cfb-0fb1-4689-aa46-bc8da2d19d9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:32.559936 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d41b6cfb-0fb1-4689-aa46-bc8da2d19d9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:32.560575 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d41b6cfb-0fb1-4689-aa46-bc8da2d19d9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:32.577343 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-d41b6cfb-0fb1-4689-aa46-bc8da2d19d9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] HTTP exception thrown: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d41b6cfb-0fb1-4689-aa46-bc8da2d19d9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Request method failure captured: Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: DELETE /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 HTTP/1.1 Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7sI7hLZHmJT4OOUC7NIrM2gO9lSTWxNJXgAxrAHI3T5nz_yFQAxgM7HfJ_1s_kNnhkka2-mx5AP_lNTeyWwF23jeiQiNujCUscDHLc0sKJVM7Xc9xYHf8TWHvDOPDMTe-Dtcbx-ln8SUa5_aM9uAAAoow709oaRlOUX6pkeOk-pjEs Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: b4516d3cd63d4d89824c4a0b20b6eea1 Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-DeleteServersTestJSON-1866216478 Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:33:32.579034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:33:32.580144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b4516d3cd63d4d89824c4a0b20b6eea1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4516d3cd63d4d89824c4a0b20b6eea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4516d3cd63d4d89824c4a0b20b6eea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b4516d3cd63d4d89824c4a0b20b6eea1"}]}] Aug 19 16:33:32.580144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-DeleteServersTestJSON-1866216478 Aug 19 16:33:32.580144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: b4516d3cd63d4d89824c4a0b20b6eea1 Aug 19 16:33:32.580144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-DeleteServersTestJSON-1866216478 Aug 19 16:33:32.580144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-DeleteServersTestJSON-1866216478-project Aug 19 16:33:32.580144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:33:32.580144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:33:32.580144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: 8d20b306fc68435baa0da6f09c915157 Aug 19 16:33:32.580144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-DeleteServersTestJSON-1866216478-project Aug 19 16:33:32.580144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:33:32.580144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. Aug 19 16:33:32.580144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': '33d89321-9f57-4555-b081-9aacd51fba08'} Aug 19 16:33:32.580803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:33:32.580803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:32.580803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:33:32.580803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:33:32.580803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:33:32.580803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:33:32.580803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:33:32.580803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:33:32.580803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:33:32.580803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:33:32.580803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. Aug 19 16:33:32.580803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:32.580803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:33:32.580803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:32.580803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:32.580803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:33:32.580803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:33:32.580803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:33:32.580803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:33:32.580803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:33:32.581820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:33:32.581820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 16:33:32.581820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 16:33:32.581820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 16:33:32.581820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 16:33:32.581820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:33:32.581820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:33:32.581820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:33:32.581820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:33:32.581820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. Aug 19 16:33:32.581820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:32.581820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:33:32.581820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:32.581820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:32.581820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:33:32.581820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:33:32.581820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:33:32.581820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:33:32.581820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. Aug 19 16:33:32.581820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:32.583107 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d41b6cfb-0fb1-4689-aa46-bc8da2d19d9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Returning 404 to user: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:33:32.585186 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d41b6cfb-0fb1-4689-aa46-bc8da2d19d9f tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "DELETE /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 404 len: 111 microversion: 2.1 time: 0.038606 Aug 19 16:33:32.588800 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 146/293] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:33:32 2022] DELETE /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:33:32.597611 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-55fc09d8-3d5e-44e1-9c07-fff22b563d81 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:32.598636 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-55fc09d8-3d5e-44e1-9c07-fff22b563d81 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] [instance: 33d89321-9f57-4555-b081-9aacd51fba08] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:32.605450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-55fc09d8-3d5e-44e1-9c07-fff22b563d81 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:32.606222 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-55fc09d8-3d5e-44e1-9c07-fff22b563d81 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:32.606662 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-55fc09d8-3d5e-44e1-9c07-fff22b563d81 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:32.607411 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-55fc09d8-3d5e-44e1-9c07-fff22b563d81 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:32.607888 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-55fc09d8-3d5e-44e1-9c07-fff22b563d81 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:32.608303 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-55fc09d8-3d5e-44e1-9c07-fff22b563d81 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:32.626426 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-55fc09d8-3d5e-44e1-9c07-fff22b563d81 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] HTTP exception thrown: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-55fc09d8-3d5e-44e1-9c07-fff22b563d81 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Request method failure captured: Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 HTTP/1.1 Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7sI7hLZHmJT4OOUC7NIrM2gO9lSTWxNJXgAxrAHI3T5nz_yFQAxgM7HfJ_1s_kNnhkka2-mx5AP_lNTeyWwF23jeiQiNujCUscDHLc0sKJVM7Xc9xYHf8TWHvDOPDMTe-Dtcbx-ln8SUa5_aM9uAAAoow709oaRlOUX6pkeOk-pjEs Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: b4516d3cd63d4d89824c4a0b20b6eea1 Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-DeleteServersTestJSON-1866216478 Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:33:32.627987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:33:32.629275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b4516d3cd63d4d89824c4a0b20b6eea1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4516d3cd63d4d89824c4a0b20b6eea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b4516d3cd63d4d89824c4a0b20b6eea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b4516d3cd63d4d89824c4a0b20b6eea1"}]}] Aug 19 16:33:32.629275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-DeleteServersTestJSON-1866216478 Aug 19 16:33:32.629275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: b4516d3cd63d4d89824c4a0b20b6eea1 Aug 19 16:33:32.629275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-DeleteServersTestJSON-1866216478 Aug 19 16:33:32.629275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-DeleteServersTestJSON-1866216478-project Aug 19 16:33:32.629275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:33:32.629275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:33:32.629275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: 8d20b306fc68435baa0da6f09c915157 Aug 19 16:33:32.629275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-DeleteServersTestJSON-1866216478-project Aug 19 16:33:32.629275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:33:32.629275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. Aug 19 16:33:32.629275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': '33d89321-9f57-4555-b081-9aacd51fba08'} Aug 19 16:33:32.630035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:33:32.630035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:32.630035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:33:32.630035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:33:32.630035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:33:32.630035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:33:32.630035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:33:32.630035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:33:32.630035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:33:32.630035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:33:32.630035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. Aug 19 16:33:32.630035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:33:32.630035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:33:32.630035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:33:32.630035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:32.630035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:33:32.630035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:33:32.630035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:33:32.630035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:33:32.630035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:33:32.631037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:33:32.631037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:33:32.631037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:33:32.631037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:33:32.631037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:33:32.631037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:33:32.631037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:33:32.631037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. Aug 19 16:33:32.631037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:33:32.631037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:33:32.631037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:33:32.631037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:32.631037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:33:32.631037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:33:32.631037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:33:32.631037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:33:32.631037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. Aug 19 16:33:32.631037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:33:32.631979 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-55fc09d8-3d5e-44e1-9c07-fff22b563d81 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] Returning 404 to user: Instance 33d89321-9f57-4555-b081-9aacd51fba08 could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:33:32.631979 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-55fc09d8-3d5e-44e1-9c07-fff22b563d81 tempest-DeleteServersTestJSON-1866216478 tempest-DeleteServersTestJSON-1866216478-project] 10.222.0.55 "GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08" status: 404 len: 111 microversion: 2.1 time: 0.039266 Aug 19 16:33:32.631979 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 148/294] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:32 2022] GET /compute/v2.1/servers/33d89321-9f57-4555-b081-9aacd51fba08 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:33:33.294497 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-89e61ed9-5aa6-4b1f-bd8a-d4fa62602f94 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:33.295268 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-89e61ed9-5aa6-4b1f-bd8a-d4fa62602f94 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:33.302257 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-89e61ed9-5aa6-4b1f-bd8a-d4fa62602f94 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:33.302809 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-89e61ed9-5aa6-4b1f-bd8a-d4fa62602f94 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:33.304346 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-89e61ed9-5aa6-4b1f-bd8a-d4fa62602f94 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:33.305390 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-89e61ed9-5aa6-4b1f-bd8a-d4fa62602f94 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:33.306028 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-89e61ed9-5aa6-4b1f-bd8a-d4fa62602f94 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:33.307069 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-89e61ed9-5aa6-4b1f-bd8a-d4fa62602f94 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:33.405712 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-89e61ed9-5aa6-4b1f-bd8a-d4fa62602f94 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:33.414316 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-89e61ed9-5aa6-4b1f-bd8a-d4fa62602f94 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 200 len: 1265 microversion: 2.1 time: 0.123777 Aug 19 16:33:33.414877 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 147/295] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:33 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 1265 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:33.495141 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-56458380-0059-4386-9b72-a918c5cf5bcd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:33.496386 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-56458380-0059-4386-9b72-a918c5cf5bcd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:33.505483 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-56458380-0059-4386-9b72-a918c5cf5bcd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:33.506382 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-56458380-0059-4386-9b72-a918c5cf5bcd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:33.507608 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-56458380-0059-4386-9b72-a918c5cf5bcd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:33.508674 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-56458380-0059-4386-9b72-a918c5cf5bcd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:33.510330 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-56458380-0059-4386-9b72-a918c5cf5bcd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:33.511208 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-56458380-0059-4386-9b72-a918c5cf5bcd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:33.802641 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-56458380-0059-4386-9b72-a918c5cf5bcd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:33.811205 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-56458380-0059-4386-9b72-a918c5cf5bcd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1520 microversion: 2.1 time: 0.320388 Aug 19 16:33:33.812990 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 149/296] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:33 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1520 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:34.434931 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b1c8fa9d-3ce7-4eee-bed9-e7f2ae73e689 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:34.435788 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-b1c8fa9d-3ce7-4eee-bed9-e7f2ae73e689 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:34.445581 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b1c8fa9d-3ce7-4eee-bed9-e7f2ae73e689 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:34.446121 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b1c8fa9d-3ce7-4eee-bed9-e7f2ae73e689 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:34.446688 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b1c8fa9d-3ce7-4eee-bed9-e7f2ae73e689 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:34.447582 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b1c8fa9d-3ce7-4eee-bed9-e7f2ae73e689 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:34.448064 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b1c8fa9d-3ce7-4eee-bed9-e7f2ae73e689 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:34.448475 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b1c8fa9d-3ce7-4eee-bed9-e7f2ae73e689 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:34.529147 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b1c8fa9d-3ce7-4eee-bed9-e7f2ae73e689 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:34.538363 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b1c8fa9d-3ce7-4eee-bed9-e7f2ae73e689 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 200 len: 1283 microversion: 2.1 time: 0.106684 Aug 19 16:33:34.539668 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 148/297] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:34 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 1283 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:34.755003 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ad4a9167-fca7-4799-ba87-9dcf0e3fd9a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1053101861", "imageRef": "da4af7b7-e205-4511-ad99-3478c2523f74", "flavorRef": "452", "networks": [{"uuid": "fdf3ee48-de6b-4ead-a10b-0bf96d819f61"}]}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:33:34.835772 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1b999fd9-164c-4997-a602-3508fc4190a3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:34.836790 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1b999fd9-164c-4997-a602-3508fc4190a3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:34.843058 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.network.neutron [None req-ad4a9167-fca7-4799-ba87-9dcf0e3fd9a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] validate_networks() for [('fdf3ee48-de6b-4ead-a10b-0bf96d819f61', None, None, None, None, None)] {{(pid=127285) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:33:34.847340 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1b999fd9-164c-4997-a602-3508fc4190a3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:34.851107 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1b999fd9-164c-4997-a602-3508fc4190a3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:34.851640 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1b999fd9-164c-4997-a602-3508fc4190a3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:34.852452 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1b999fd9-164c-4997-a602-3508fc4190a3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:34.854296 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1b999fd9-164c-4997-a602-3508fc4190a3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:34.857878 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1b999fd9-164c-4997-a602-3508fc4190a3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:35.209181 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1b999fd9-164c-4997-a602-3508fc4190a3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:35.225718 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1b999fd9-164c-4997-a602-3508fc4190a3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1500 microversion: 2.1 time: 0.395056 Aug 19 16:33:35.236870 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 149/298] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:34 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1500 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:35.247490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2850cd93-3c09-4a83-845a-c313a1ddfe6a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:35.248656 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2850cd93-3c09-4a83-845a-c313a1ddfe6a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:35.254720 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=81 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:33:35.258233 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2850cd93-3c09-4a83-845a-c313a1ddfe6a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:35.259300 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2850cd93-3c09-4a83-845a-c313a1ddfe6a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:35.259753 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2850cd93-3c09-4a83-845a-c313a1ddfe6a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:35.260771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2850cd93-3c09-4a83-845a-c313a1ddfe6a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:35.261391 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2850cd93-3c09-4a83-845a-c313a1ddfe6a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:35.262217 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2850cd93-3c09-4a83-845a-c313a1ddfe6a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:35.503586 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2850cd93-3c09-4a83-845a-c313a1ddfe6a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:35.520517 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2850cd93-3c09-4a83-845a-c313a1ddfe6a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1515 microversion: 2.1 time: 0.277457 Aug 19 16:33:35.521126 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 150/299] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:35 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1515 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:35.560324 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-abc010b3-3f34-4973-850a-ff736e207a4b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:35.561120 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-abc010b3-3f34-4973-850a-ff736e207a4b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:35.568322 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-abc010b3-3f34-4973-850a-ff736e207a4b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:35.569605 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-abc010b3-3f34-4973-850a-ff736e207a4b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:35.570209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-abc010b3-3f34-4973-850a-ff736e207a4b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:35.571994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-abc010b3-3f34-4973-850a-ff736e207a4b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:35.572609 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-abc010b3-3f34-4973-850a-ff736e207a4b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:35.573217 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-abc010b3-3f34-4973-850a-ff736e207a4b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:35.660601 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-ad4a9167-fca7-4799-ba87-9dcf0e3fd9a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Flavor limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:33:35.661045 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-ad4a9167-fca7-4799-ba87-9dcf0e3fd9a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Image limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:33:35.661509 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-ad4a9167-fca7-4799-ba87-9dcf0e3fd9a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Flavor pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:33:35.662212 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-ad4a9167-fca7-4799-ba87-9dcf0e3fd9a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Image pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:33:35.663160 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-ad4a9167-fca7-4799-ba87-9dcf0e3fd9a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:33:35.673125 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad4a9167-fca7-4799-ba87-9dcf0e3fd9a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:35.673651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad4a9167-fca7-4799-ba87-9dcf0e3fd9a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:35.674412 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad4a9167-fca7-4799-ba87-9dcf0e3fd9a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:35.675426 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad4a9167-fca7-4799-ba87-9dcf0e3fd9a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:35.676058 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad4a9167-fca7-4799-ba87-9dcf0e3fd9a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:35.676591 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad4a9167-fca7-4799-ba87-9dcf0e3fd9a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:35.700410 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-ad4a9167-fca7-4799-ba87-9dcf0e3fd9a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Getting quotas for project b34c07333ddf4a19b35424d47d19dc60. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:33:35.706077 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-ad4a9167-fca7-4799-ba87-9dcf0e3fd9a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Getting quotas for user d9e505bb350e4134976000a83bdd4fe1 and project b34c07333ddf4a19b35424d47d19dc60. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:33:35.718775 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ad4a9167-fca7-4799-ba87-9dcf0e3fd9a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Going to run 1 instances... {{(pid=127285) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:33:35.721403 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ad4a9167-fca7-4799-ba87-9dcf0e3fd9a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='da4af7b7-e205-4511-ad99-3478c2523f74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127285) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:33:35.788778 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ad4a9167-fca7-4799-ba87-9dcf0e3fd9a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.036831 Aug 19 16:33:35.789964 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 150/300] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Aug 19 16:33:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 16:33:35.800668 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-009235d4-3e1b-4518-ab73-2f21ab5e48ec tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:35.801404 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-009235d4-3e1b-4518-ab73-2f21ab5e48ec tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:35.824031 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-abc010b3-3f34-4973-850a-ff736e207a4b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:35.833088 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-abc010b3-3f34-4973-850a-ff736e207a4b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 200 len: 1313 microversion: 2.1 time: 0.276392 Aug 19 16:33:35.836394 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 151/301] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:35 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:35.925259 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-009235d4-3e1b-4518-ab73-2f21ab5e48ec tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:35.936365 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-009235d4-3e1b-4518-ab73-2f21ab5e48ec tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1219 microversion: 2.1 time: 0.139501 Aug 19 16:33:35.936964 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 151/302] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:35 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:36.638868 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-75db6a13-42f3-4333-b67c-9cccb3957292 req-e9eee3e0-b16f-4794-97df-71f5ea03c61d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "082cc16e-016a-4784-8c10-dd93060f3b63", "tag": "183cc255-8e84-4291-8cd3-450c3a6ad74a"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:33:36.661996 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-75db6a13-42f3-4333-b67c-9cccb3957292 req-e9eee3e0-b16f-4794-97df-71f5ea03c61d service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:36.663107 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-75db6a13-42f3-4333-b67c-9cccb3957292 req-e9eee3e0-b16f-4794-97df-71f5ea03c61d service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:36.663645 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-75db6a13-42f3-4333-b67c-9cccb3957292 req-e9eee3e0-b16f-4794-97df-71f5ea03c61d service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:36.697666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-75db6a13-42f3-4333-b67c-9cccb3957292 req-e9eee3e0-b16f-4794-97df-71f5ea03c61d service nova] Creating event network-changed:183cc255-8e84-4291-8cd3-450c3a6ad74a for instance 082cc16e-016a-4784-8c10-dd93060f3b63 on hv-cinder-83124 Aug 19 16:33:36.720903 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-75db6a13-42f3-4333-b67c-9cccb3957292 req-e9eee3e0-b16f-4794-97df-71f5ea03c61d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086990 Aug 19 16:33:36.721502 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 152/303] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:33:36.861964 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-99bc9c4d-0e3b-427b-9abb-6ec7cc7c2390 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:36.863298 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-99bc9c4d-0e3b-427b-9abb-6ec7cc7c2390 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:36.872026 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-99bc9c4d-0e3b-427b-9abb-6ec7cc7c2390 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:36.872501 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-99bc9c4d-0e3b-427b-9abb-6ec7cc7c2390 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:36.873228 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-99bc9c4d-0e3b-427b-9abb-6ec7cc7c2390 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:36.874227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-99bc9c4d-0e3b-427b-9abb-6ec7cc7c2390 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:36.875068 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-99bc9c4d-0e3b-427b-9abb-6ec7cc7c2390 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:36.885416 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-99bc9c4d-0e3b-427b-9abb-6ec7cc7c2390 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:36.966637 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1f90f57d-757c-42b0-a847-03e76ee4b64d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:36.968982 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1f90f57d-757c-42b0-a847-03e76ee4b64d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:36.978376 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1f90f57d-757c-42b0-a847-03e76ee4b64d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:36.984522 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1f90f57d-757c-42b0-a847-03e76ee4b64d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:36.985158 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1f90f57d-757c-42b0-a847-03e76ee4b64d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:36.986165 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1f90f57d-757c-42b0-a847-03e76ee4b64d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:36.986637 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1f90f57d-757c-42b0-a847-03e76ee4b64d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:36.987161 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1f90f57d-757c-42b0-a847-03e76ee4b64d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:37.118544 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1f90f57d-757c-42b0-a847-03e76ee4b64d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:37.127886 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1f90f57d-757c-42b0-a847-03e76ee4b64d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1271 microversion: 2.1 time: 0.169032 Aug 19 16:33:37.128683 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 153/304] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:36 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:37.168055 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-99bc9c4d-0e3b-427b-9abb-6ec7cc7c2390 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:37.181515 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-99bc9c4d-0e3b-427b-9abb-6ec7cc7c2390 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 200 len: 1313 microversion: 2.1 time: 0.326635 Aug 19 16:33:37.183407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 152/305] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:36 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:37.223775 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8b525228-4da6-4dec-b1bd-93e9c45af72a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:33:37.226078 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8b525228-4da6-4dec-b1bd-93e9c45af72a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:37.233207 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b525228-4da6-4dec-b1bd-93e9c45af72a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:37.233878 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b525228-4da6-4dec-b1bd-93e9c45af72a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:37.234316 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b525228-4da6-4dec-b1bd-93e9c45af72a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:37.235019 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b525228-4da6-4dec-b1bd-93e9c45af72a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:37.235576 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b525228-4da6-4dec-b1bd-93e9c45af72a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:37.236189 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b525228-4da6-4dec-b1bd-93e9c45af72a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:37.264916 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.objects.instance [None req-8b525228-4da6-4dec-b1bd-93e9c45af72a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lazy-loading 'flavor' on Instance uuid 73fc9558-1f91-4cbd-b5f1-9342dc7d6148 {{(pid=127284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:33:37.327558 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=100 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:33:37.400415 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8b525228-4da6-4dec-b1bd-93e9c45af72a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "POST /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148/action" status: 200 len: 32 microversion: 2.1 time: 0.180647 Aug 19 16:33:37.401206 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 154/306] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Aug 19 16:33:37 2022] POST /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148/action => generated 32 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 16:33:37.410443 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0b63c5be-6ea9-4716-9cb1-f62090c47d18 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:37.411053 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-0b63c5be-6ea9-4716-9cb1-f62090c47d18 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:37.417474 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0b63c5be-6ea9-4716-9cb1-f62090c47d18 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:37.417949 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0b63c5be-6ea9-4716-9cb1-f62090c47d18 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:37.418379 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0b63c5be-6ea9-4716-9cb1-f62090c47d18 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:37.419060 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0b63c5be-6ea9-4716-9cb1-f62090c47d18 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:37.419546 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0b63c5be-6ea9-4716-9cb1-f62090c47d18 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:37.419972 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0b63c5be-6ea9-4716-9cb1-f62090c47d18 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:37.618388 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-0b63c5be-6ea9-4716-9cb1-f62090c47d18 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:37.627088 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-0b63c5be-6ea9-4716-9cb1-f62090c47d18 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.220368 Aug 19 16:33:37.628051 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 153/307] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:37 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:38.151732 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7024503b-f124-424e-8422-b229371a0f8b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:38.152524 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7024503b-f124-424e-8422-b229371a0f8b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:38.159632 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7024503b-f124-424e-8422-b229371a0f8b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:38.160230 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7024503b-f124-424e-8422-b229371a0f8b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:38.160939 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7024503b-f124-424e-8422-b229371a0f8b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:38.161787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7024503b-f124-424e-8422-b229371a0f8b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:38.162239 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7024503b-f124-424e-8422-b229371a0f8b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:38.163214 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7024503b-f124-424e-8422-b229371a0f8b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:38.203890 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2cfab47a-5075-47f8-ac29-adaf75f0451c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:38.204729 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2cfab47a-5075-47f8-ac29-adaf75f0451c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:38.208386 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:33:38.214887 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2cfab47a-5075-47f8-ac29-adaf75f0451c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:38.219177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2cfab47a-5075-47f8-ac29-adaf75f0451c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:38.221110 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2cfab47a-5075-47f8-ac29-adaf75f0451c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:38.223155 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2cfab47a-5075-47f8-ac29-adaf75f0451c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:38.225525 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2cfab47a-5075-47f8-ac29-adaf75f0451c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:38.227344 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2cfab47a-5075-47f8-ac29-adaf75f0451c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:38.234479 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7024503b-f124-424e-8422-b229371a0f8b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:38.243918 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7024503b-f124-424e-8422-b229371a0f8b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1277 microversion: 2.1 time: 0.098477 Aug 19 16:33:38.244720 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 155/308] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:38 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:38.442732 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2cfab47a-5075-47f8-ac29-adaf75f0451c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:38.451037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2cfab47a-5075-47f8-ac29-adaf75f0451c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 200 len: 1313 microversion: 2.1 time: 0.251433 Aug 19 16:33:38.465227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 154/309] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:38 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:38.652347 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-0b9cf6ae-4fb0-48cf-9a29-9d956b0ef0cf tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:38.653369 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-0b9cf6ae-4fb0-48cf-9a29-9d956b0ef0cf tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:38.660019 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0b9cf6ae-4fb0-48cf-9a29-9d956b0ef0cf tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:38.660672 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0b9cf6ae-4fb0-48cf-9a29-9d956b0ef0cf tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:38.661334 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0b9cf6ae-4fb0-48cf-9a29-9d956b0ef0cf tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:38.662029 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0b9cf6ae-4fb0-48cf-9a29-9d956b0ef0cf tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:38.662518 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0b9cf6ae-4fb0-48cf-9a29-9d956b0ef0cf tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:38.662970 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0b9cf6ae-4fb0-48cf-9a29-9d956b0ef0cf tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:38.799459 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-0b9cf6ae-4fb0-48cf-9a29-9d956b0ef0cf tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:38.807643 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-0b9cf6ae-4fb0-48cf-9a29-9d956b0ef0cf tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.159226 Aug 19 16:33:38.808202 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 156/310] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:38 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:39.265355 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6135d7a8-bc0c-41fb-a419-1d42b50b9cbc tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:39.265972 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6135d7a8-bc0c-41fb-a419-1d42b50b9cbc tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:39.272718 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6135d7a8-bc0c-41fb-a419-1d42b50b9cbc tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:39.273300 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6135d7a8-bc0c-41fb-a419-1d42b50b9cbc tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:39.274095 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6135d7a8-bc0c-41fb-a419-1d42b50b9cbc tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:39.274905 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6135d7a8-bc0c-41fb-a419-1d42b50b9cbc tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:39.275429 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6135d7a8-bc0c-41fb-a419-1d42b50b9cbc tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:39.275937 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6135d7a8-bc0c-41fb-a419-1d42b50b9cbc tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:39.419045 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6135d7a8-bc0c-41fb-a419-1d42b50b9cbc tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:39.427595 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6135d7a8-bc0c-41fb-a419-1d42b50b9cbc tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1319 microversion: 2.1 time: 0.166090 Aug 19 16:33:39.428228 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 155/311] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:39 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:39.474019 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ea45280d-d752-480b-9cde-a4b6095dbeee tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:39.475784 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ea45280d-d752-480b-9cde-a4b6095dbeee tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:39.482600 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea45280d-d752-480b-9cde-a4b6095dbeee tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:39.483285 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea45280d-d752-480b-9cde-a4b6095dbeee tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:39.483720 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea45280d-d752-480b-9cde-a4b6095dbeee tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:39.484586 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea45280d-d752-480b-9cde-a4b6095dbeee tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:39.485073 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea45280d-d752-480b-9cde-a4b6095dbeee tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:39.485494 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea45280d-d752-480b-9cde-a4b6095dbeee tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:39.723872 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ea45280d-d752-480b-9cde-a4b6095dbeee tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:39.735937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ea45280d-d752-480b-9cde-a4b6095dbeee tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 200 len: 1313 microversion: 2.1 time: 0.265971 Aug 19 16:33:39.736848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 157/312] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:39 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:39.829069 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-73411f93-0b66-47bc-aee3-30f8ec3407c2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:39.829677 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-73411f93-0b66-47bc-aee3-30f8ec3407c2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:39.837295 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-73411f93-0b66-47bc-aee3-30f8ec3407c2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:39.837942 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-73411f93-0b66-47bc-aee3-30f8ec3407c2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:39.838388 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-73411f93-0b66-47bc-aee3-30f8ec3407c2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:39.839212 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-73411f93-0b66-47bc-aee3-30f8ec3407c2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:39.839718 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-73411f93-0b66-47bc-aee3-30f8ec3407c2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:39.840283 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-73411f93-0b66-47bc-aee3-30f8ec3407c2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:40.078945 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-73411f93-0b66-47bc-aee3-30f8ec3407c2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:40.089415 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-73411f93-0b66-47bc-aee3-30f8ec3407c2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.264025 Aug 19 16:33:40.090228 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 156/313] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:39 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:40.449803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-874d56f6-6a70-4d39-a507-e679cc39edc1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:40.450940 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-874d56f6-6a70-4d39-a507-e679cc39edc1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:40.460447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-874d56f6-6a70-4d39-a507-e679cc39edc1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:40.461280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-874d56f6-6a70-4d39-a507-e679cc39edc1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:40.461787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-874d56f6-6a70-4d39-a507-e679cc39edc1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:40.463206 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-874d56f6-6a70-4d39-a507-e679cc39edc1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:40.463858 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-874d56f6-6a70-4d39-a507-e679cc39edc1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:40.464446 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-874d56f6-6a70-4d39-a507-e679cc39edc1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:40.520231 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-aebd5c33-3f26-4e68-811b-0c4c02e15a8f req-34a83c5a-6e9c-4e18-b516-4d467b6fa3ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38a84b78-4b40-4cfe-b649-528c7dad0f32", "tag": "78290210-89a1-48d0-a016-f3d5096766a8"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:33:40.544063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-aebd5c33-3f26-4e68-811b-0c4c02e15a8f req-34a83c5a-6e9c-4e18-b516-4d467b6fa3ee service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:40.545713 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-aebd5c33-3f26-4e68-811b-0c4c02e15a8f req-34a83c5a-6e9c-4e18-b516-4d467b6fa3ee service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:40.546465 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-aebd5c33-3f26-4e68-811b-0c4c02e15a8f req-34a83c5a-6e9c-4e18-b516-4d467b6fa3ee service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:40.562766 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-aebd5c33-3f26-4e68-811b-0c4c02e15a8f req-34a83c5a-6e9c-4e18-b516-4d467b6fa3ee service nova] Creating event network-changed:78290210-89a1-48d0-a016-f3d5096766a8 for instance 38a84b78-4b40-4cfe-b649-528c7dad0f32 on hv-cinder-83124 Aug 19 16:33:40.569499 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-aebd5c33-3f26-4e68-811b-0c4c02e15a8f req-34a83c5a-6e9c-4e18-b516-4d467b6fa3ee service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051945 Aug 19 16:33:40.580638 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 157/314] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:33:40.654705 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-874d56f6-6a70-4d39-a507-e679cc39edc1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:40.665398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-874d56f6-6a70-4d39-a507-e679cc39edc1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1319 microversion: 2.1 time: 0.221744 Aug 19 16:33:40.680158 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 158/315] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:40 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:40.758701 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3089c2e8-5cdd-4e0b-b7ad-e06e3dbb7937 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:40.759402 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-3089c2e8-5cdd-4e0b-b7ad-e06e3dbb7937 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:40.767979 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3089c2e8-5cdd-4e0b-b7ad-e06e3dbb7937 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:40.768453 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3089c2e8-5cdd-4e0b-b7ad-e06e3dbb7937 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:40.768933 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3089c2e8-5cdd-4e0b-b7ad-e06e3dbb7937 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:40.769623 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3089c2e8-5cdd-4e0b-b7ad-e06e3dbb7937 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:40.770072 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3089c2e8-5cdd-4e0b-b7ad-e06e3dbb7937 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:40.770486 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3089c2e8-5cdd-4e0b-b7ad-e06e3dbb7937 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:40.988804 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-3089c2e8-5cdd-4e0b-b7ad-e06e3dbb7937 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:40.997637 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3089c2e8-5cdd-4e0b-b7ad-e06e3dbb7937 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 200 len: 1313 microversion: 2.1 time: 0.243384 Aug 19 16:33:41.011148 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 158/316] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:40 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:41.111270 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-bee551b5-3a05-4715-8d13-6fb4b3261981 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:41.112061 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-bee551b5-3a05-4715-8d13-6fb4b3261981 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:41.120457 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bee551b5-3a05-4715-8d13-6fb4b3261981 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:41.121282 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bee551b5-3a05-4715-8d13-6fb4b3261981 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:41.121955 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bee551b5-3a05-4715-8d13-6fb4b3261981 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:41.122893 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bee551b5-3a05-4715-8d13-6fb4b3261981 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:41.123560 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bee551b5-3a05-4715-8d13-6fb4b3261981 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:41.124189 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bee551b5-3a05-4715-8d13-6fb4b3261981 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:41.289055 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-bee551b5-3a05-4715-8d13-6fb4b3261981 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:41.299648 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-bee551b5-3a05-4715-8d13-6fb4b3261981 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.192246 Aug 19 16:33:41.306312 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 159/317] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:41 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:41.687242 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0368dff2-3b23-404b-bc79-b7740c0678e0 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:41.687847 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-0368dff2-3b23-404b-bc79-b7740c0678e0 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:41.693632 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0368dff2-3b23-404b-bc79-b7740c0678e0 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:41.694103 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0368dff2-3b23-404b-bc79-b7740c0678e0 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:41.694625 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0368dff2-3b23-404b-bc79-b7740c0678e0 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:41.695207 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0368dff2-3b23-404b-bc79-b7740c0678e0 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:41.695652 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0368dff2-3b23-404b-bc79-b7740c0678e0 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:41.696068 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0368dff2-3b23-404b-bc79-b7740c0678e0 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:41.824869 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-0368dff2-3b23-404b-bc79-b7740c0678e0 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:41.832618 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-0368dff2-3b23-404b-bc79-b7740c0678e0 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1319 microversion: 2.1 time: 0.148911 Aug 19 16:33:41.833407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 159/318] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:41 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:42.020146 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f3e6a7a0-3fee-4471-a20b-7d7cc87bf232 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:42.022245 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f3e6a7a0-3fee-4471-a20b-7d7cc87bf232 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:42.029743 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f3e6a7a0-3fee-4471-a20b-7d7cc87bf232 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:42.030161 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f3e6a7a0-3fee-4471-a20b-7d7cc87bf232 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:42.030600 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f3e6a7a0-3fee-4471-a20b-7d7cc87bf232 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:42.031327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f3e6a7a0-3fee-4471-a20b-7d7cc87bf232 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:42.031777 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f3e6a7a0-3fee-4471-a20b-7d7cc87bf232 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:42.032198 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f3e6a7a0-3fee-4471-a20b-7d7cc87bf232 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:42.168678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f3e6a7a0-3fee-4471-a20b-7d7cc87bf232 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:42.176436 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f3e6a7a0-3fee-4471-a20b-7d7cc87bf232 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 200 len: 1313 microversion: 2.1 time: 0.161047 Aug 19 16:33:42.177024 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 160/319] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:42 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:42.321939 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-39e55d88-02b1-4e02-99ff-e2b33959e3d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:42.322588 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-39e55d88-02b1-4e02-99ff-e2b33959e3d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:42.328578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-39e55d88-02b1-4e02-99ff-e2b33959e3d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:42.329094 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-39e55d88-02b1-4e02-99ff-e2b33959e3d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:42.329569 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-39e55d88-02b1-4e02-99ff-e2b33959e3d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:42.330260 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-39e55d88-02b1-4e02-99ff-e2b33959e3d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:42.330709 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-39e55d88-02b1-4e02-99ff-e2b33959e3d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:42.331150 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-39e55d88-02b1-4e02-99ff-e2b33959e3d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:42.471762 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-39e55d88-02b1-4e02-99ff-e2b33959e3d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:42.479509 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-39e55d88-02b1-4e02-99ff-e2b33959e3d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.162131 Aug 19 16:33:42.480100 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 160/320] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:42 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:42.854764 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-67ac2339-81ff-4ecd-823f-3ff1074e2000 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:42.855375 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-67ac2339-81ff-4ecd-823f-3ff1074e2000 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:42.857348 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=2 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:33:42.862659 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-67ac2339-81ff-4ecd-823f-3ff1074e2000 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:42.863148 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-67ac2339-81ff-4ecd-823f-3ff1074e2000 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:42.863576 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-67ac2339-81ff-4ecd-823f-3ff1074e2000 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:42.864263 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-67ac2339-81ff-4ecd-823f-3ff1074e2000 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:42.864738 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-67ac2339-81ff-4ecd-823f-3ff1074e2000 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:42.865190 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-67ac2339-81ff-4ecd-823f-3ff1074e2000 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:42.998096 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-67ac2339-81ff-4ecd-823f-3ff1074e2000 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:43.005623 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-67ac2339-81ff-4ecd-823f-3ff1074e2000 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1319 microversion: 2.1 time: 0.154922 Aug 19 16:33:43.006173 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 161/321] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:42 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:43.197906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f2f7eb98-a9e3-4230-9fdf-1401e50f391d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:43.198521 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f2f7eb98-a9e3-4230-9fdf-1401e50f391d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:43.204845 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f2f7eb98-a9e3-4230-9fdf-1401e50f391d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:43.205375 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f2f7eb98-a9e3-4230-9fdf-1401e50f391d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:43.205844 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f2f7eb98-a9e3-4230-9fdf-1401e50f391d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:43.206543 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f2f7eb98-a9e3-4230-9fdf-1401e50f391d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:43.206989 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f2f7eb98-a9e3-4230-9fdf-1401e50f391d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:43.207663 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f2f7eb98-a9e3-4230-9fdf-1401e50f391d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:43.318102 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-94edd088-8239-416e-86e7-4d35309e8bd0 req-c84cbb38-4a9f-412e-8983-633fdb014302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "082cc16e-016a-4784-8c10-dd93060f3b63", "name": "network-vif-plugged", "status": "completed", "tag": "183cc255-8e84-4291-8cd3-450c3a6ad74a"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:33:43.328493 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-94edd088-8239-416e-86e7-4d35309e8bd0 req-c84cbb38-4a9f-412e-8983-633fdb014302 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:43.329001 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-94edd088-8239-416e-86e7-4d35309e8bd0 req-c84cbb38-4a9f-412e-8983-633fdb014302 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:43.329439 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-94edd088-8239-416e-86e7-4d35309e8bd0 req-c84cbb38-4a9f-412e-8983-633fdb014302 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:43.342750 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-94edd088-8239-416e-86e7-4d35309e8bd0 req-c84cbb38-4a9f-412e-8983-633fdb014302 service nova] Creating event network-vif-plugged:183cc255-8e84-4291-8cd3-450c3a6ad74a for instance 082cc16e-016a-4784-8c10-dd93060f3b63 on hv-cinder-83124 Aug 19 16:33:43.343676 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f2f7eb98-a9e3-4230-9fdf-1401e50f391d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:43.347647 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-94edd088-8239-416e-86e7-4d35309e8bd0 req-c84cbb38-4a9f-412e-8983-633fdb014302 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033619 Aug 19 16:33:43.348242 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 162/322] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:33:43.352303 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f2f7eb98-a9e3-4230-9fdf-1401e50f391d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 200 len: 1313 microversion: 2.1 time: 0.158757 Aug 19 16:33:43.352908 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 161/323] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:43 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:43.501062 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-35649e06-c7da-42fd-8fb8-d53103642ff6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:43.501759 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-35649e06-c7da-42fd-8fb8-d53103642ff6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:43.509183 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35649e06-c7da-42fd-8fb8-d53103642ff6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:43.509664 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35649e06-c7da-42fd-8fb8-d53103642ff6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:43.510227 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35649e06-c7da-42fd-8fb8-d53103642ff6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:43.510978 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35649e06-c7da-42fd-8fb8-d53103642ff6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:43.511429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35649e06-c7da-42fd-8fb8-d53103642ff6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:43.512142 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35649e06-c7da-42fd-8fb8-d53103642ff6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:43.650102 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-35649e06-c7da-42fd-8fb8-d53103642ff6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:43.658769 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-35649e06-c7da-42fd-8fb8-d53103642ff6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.161937 Aug 19 16:33:43.659297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 163/324] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:43 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:44.025396 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-fbd583ba-da76-4e34-8d9e-8ce32f46f974 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:44.025966 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-fbd583ba-da76-4e34-8d9e-8ce32f46f974 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:44.031792 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fbd583ba-da76-4e34-8d9e-8ce32f46f974 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:44.032263 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fbd583ba-da76-4e34-8d9e-8ce32f46f974 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:44.032689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fbd583ba-da76-4e34-8d9e-8ce32f46f974 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:44.033455 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fbd583ba-da76-4e34-8d9e-8ce32f46f974 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:44.033901 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fbd583ba-da76-4e34-8d9e-8ce32f46f974 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:44.034316 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fbd583ba-da76-4e34-8d9e-8ce32f46f974 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:44.165321 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fbd583ba-da76-4e34-8d9e-8ce32f46f974 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:44.172959 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-fbd583ba-da76-4e34-8d9e-8ce32f46f974 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1319 microversion: 2.1 time: 0.151417 Aug 19 16:33:44.173512 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 162/325] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:44 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:44.373121 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f57b7a4d-863f-468b-ace7-41b9a52a473b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:44.373656 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f57b7a4d-863f-468b-ace7-41b9a52a473b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:44.379995 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f57b7a4d-863f-468b-ace7-41b9a52a473b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:44.380472 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f57b7a4d-863f-468b-ace7-41b9a52a473b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:44.380949 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f57b7a4d-863f-468b-ace7-41b9a52a473b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:44.381743 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f57b7a4d-863f-468b-ace7-41b9a52a473b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:44.382192 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f57b7a4d-863f-468b-ace7-41b9a52a473b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:44.382615 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f57b7a4d-863f-468b-ace7-41b9a52a473b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:44.509746 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f57b7a4d-863f-468b-ace7-41b9a52a473b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:44.517217 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f57b7a4d-863f-468b-ace7-41b9a52a473b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 200 len: 1313 microversion: 2.1 time: 0.148023 Aug 19 16:33:44.517776 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 164/326] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:44 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:44.679681 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-db2c78ed-cc65-4559-a73e-9ba36da1a2f0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:44.680295 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-db2c78ed-cc65-4559-a73e-9ba36da1a2f0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:44.686191 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-db2c78ed-cc65-4559-a73e-9ba36da1a2f0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:44.686671 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-db2c78ed-cc65-4559-a73e-9ba36da1a2f0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:44.687106 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-db2c78ed-cc65-4559-a73e-9ba36da1a2f0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:44.687846 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-db2c78ed-cc65-4559-a73e-9ba36da1a2f0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:44.688297 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-db2c78ed-cc65-4559-a73e-9ba36da1a2f0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:44.688720 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-db2c78ed-cc65-4559-a73e-9ba36da1a2f0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:44.816229 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-db2c78ed-cc65-4559-a73e-9ba36da1a2f0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:44.824514 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-db2c78ed-cc65-4559-a73e-9ba36da1a2f0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.148909 Aug 19 16:33:44.825175 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 163/327] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:44 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:45.195650 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c526a596-cced-4874-b934-5b7a2ea5d4d1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:45.196499 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-c526a596-cced-4874-b934-5b7a2ea5d4d1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:45.202910 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c526a596-cced-4874-b934-5b7a2ea5d4d1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:45.203396 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c526a596-cced-4874-b934-5b7a2ea5d4d1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:45.203834 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c526a596-cced-4874-b934-5b7a2ea5d4d1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:45.204774 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c526a596-cced-4874-b934-5b7a2ea5d4d1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:45.205389 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c526a596-cced-4874-b934-5b7a2ea5d4d1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:45.205825 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c526a596-cced-4874-b934-5b7a2ea5d4d1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:45.341900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c526a596-cced-4874-b934-5b7a2ea5d4d1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:45.350915 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c526a596-cced-4874-b934-5b7a2ea5d4d1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1319 microversion: 2.1 time: 0.160338 Aug 19 16:33:45.352084 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 165/328] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:45 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:45.538282 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-20e99cc6-856d-4b4f-83df-0be68a2b9d89 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:45.538843 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-20e99cc6-856d-4b4f-83df-0be68a2b9d89 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:45.544696 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-20e99cc6-856d-4b4f-83df-0be68a2b9d89 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:45.545219 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-20e99cc6-856d-4b4f-83df-0be68a2b9d89 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:45.545646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-20e99cc6-856d-4b4f-83df-0be68a2b9d89 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:45.546318 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-20e99cc6-856d-4b4f-83df-0be68a2b9d89 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:45.546762 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-20e99cc6-856d-4b4f-83df-0be68a2b9d89 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:45.547180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-20e99cc6-856d-4b4f-83df-0be68a2b9d89 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:45.678932 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-20e99cc6-856d-4b4f-83df-0be68a2b9d89 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:45.684968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=4 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:33:45.687768 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-20e99cc6-856d-4b4f-83df-0be68a2b9d89 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 200 len: 1497 microversion: 2.1 time: 0.153417 Aug 19 16:33:45.688337 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 164/329] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:45 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:45.845840 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-12d4d02b-1d76-4b57-a7bd-89a80a4b16ce tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:45.846407 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-12d4d02b-1d76-4b57-a7bd-89a80a4b16ce tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:45.853260 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-12d4d02b-1d76-4b57-a7bd-89a80a4b16ce tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:45.853734 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-12d4d02b-1d76-4b57-a7bd-89a80a4b16ce tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:45.854166 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-12d4d02b-1d76-4b57-a7bd-89a80a4b16ce tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:45.854844 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-12d4d02b-1d76-4b57-a7bd-89a80a4b16ce tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:45.855290 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-12d4d02b-1d76-4b57-a7bd-89a80a4b16ce tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:45.855707 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-12d4d02b-1d76-4b57-a7bd-89a80a4b16ce tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:45.984206 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-12d4d02b-1d76-4b57-a7bd-89a80a4b16ce tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:45.992686 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-12d4d02b-1d76-4b57-a7bd-89a80a4b16ce tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.150706 Aug 19 16:33:45.993276 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 166/330] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:45 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:46.371629 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c2c04474-efef-4fb5-ae03-f4b9f1dccc56 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:46.372242 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c2c04474-efef-4fb5-ae03-f4b9f1dccc56 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:46.374418 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=14 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:33:46.380067 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2c04474-efef-4fb5-ae03-f4b9f1dccc56 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:46.380550 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2c04474-efef-4fb5-ae03-f4b9f1dccc56 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:46.381528 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2c04474-efef-4fb5-ae03-f4b9f1dccc56 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:46.382430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2c04474-efef-4fb5-ae03-f4b9f1dccc56 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:46.382928 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2c04474-efef-4fb5-ae03-f4b9f1dccc56 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:46.383357 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2c04474-efef-4fb5-ae03-f4b9f1dccc56 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:46.511221 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c2c04474-efef-4fb5-ae03-f4b9f1dccc56 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:46.518678 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c2c04474-efef-4fb5-ae03-f4b9f1dccc56 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1319 microversion: 2.1 time: 0.150870 Aug 19 16:33:46.519244 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 165/331] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:46 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:47.013496 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8006cb5d-5403-40d8-bce0-7eff07c7ad5b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:47.014097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8006cb5d-5403-40d8-bce0-7eff07c7ad5b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:47.020538 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8006cb5d-5403-40d8-bce0-7eff07c7ad5b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:47.021031 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8006cb5d-5403-40d8-bce0-7eff07c7ad5b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:47.021464 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8006cb5d-5403-40d8-bce0-7eff07c7ad5b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:47.022141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8006cb5d-5403-40d8-bce0-7eff07c7ad5b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:47.022589 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8006cb5d-5403-40d8-bce0-7eff07c7ad5b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:47.023009 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8006cb5d-5403-40d8-bce0-7eff07c7ad5b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:47.149071 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8006cb5d-5403-40d8-bce0-7eff07c7ad5b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:47.156536 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8006cb5d-5403-40d8-bce0-7eff07c7ad5b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.146982 Aug 19 16:33:47.157117 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 167/332] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:47 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:47.540345 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c128b9fe-f758-4145-a193-6e859aecee2a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:47.540986 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c128b9fe-f758-4145-a193-6e859aecee2a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:47.546824 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c128b9fe-f758-4145-a193-6e859aecee2a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:47.547296 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c128b9fe-f758-4145-a193-6e859aecee2a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:47.547726 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c128b9fe-f758-4145-a193-6e859aecee2a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:47.548403 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c128b9fe-f758-4145-a193-6e859aecee2a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:47.548877 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c128b9fe-f758-4145-a193-6e859aecee2a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:47.549297 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c128b9fe-f758-4145-a193-6e859aecee2a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:47.686138 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c128b9fe-f758-4145-a193-6e859aecee2a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:47.693922 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c128b9fe-f758-4145-a193-6e859aecee2a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1319 microversion: 2.1 time: 0.157885 Aug 19 16:33:47.694479 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 166/333] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:47 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:48.179642 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7fc789ba-b3dc-4c72-9824-d07ef2d1fec1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:48.180246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7fc789ba-b3dc-4c72-9824-d07ef2d1fec1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:48.186637 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7fc789ba-b3dc-4c72-9824-d07ef2d1fec1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:48.187103 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7fc789ba-b3dc-4c72-9824-d07ef2d1fec1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:48.187528 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7fc789ba-b3dc-4c72-9824-d07ef2d1fec1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:48.188204 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7fc789ba-b3dc-4c72-9824-d07ef2d1fec1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:48.188649 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7fc789ba-b3dc-4c72-9824-d07ef2d1fec1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:48.189100 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7fc789ba-b3dc-4c72-9824-d07ef2d1fec1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:48.319573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7fc789ba-b3dc-4c72-9824-d07ef2d1fec1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:48.327389 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7fc789ba-b3dc-4c72-9824-d07ef2d1fec1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.151540 Aug 19 16:33:48.327983 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 168/334] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:48 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:48.715333 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-344b521c-f92c-40f5-898c-f46c125520a1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:48.716656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-344b521c-f92c-40f5-898c-f46c125520a1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:48.722895 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-344b521c-f92c-40f5-898c-f46c125520a1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:48.723372 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-344b521c-f92c-40f5-898c-f46c125520a1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:48.723806 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-344b521c-f92c-40f5-898c-f46c125520a1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:48.724527 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-344b521c-f92c-40f5-898c-f46c125520a1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:48.725629 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-344b521c-f92c-40f5-898c-f46c125520a1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:48.726146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-344b521c-f92c-40f5-898c-f46c125520a1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:48.730167 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=100 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:33:48.861762 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-344b521c-f92c-40f5-898c-f46c125520a1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:48.871763 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-344b521c-f92c-40f5-898c-f46c125520a1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1319 microversion: 2.1 time: 0.160400 Aug 19 16:33:48.872436 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 167/335] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:48 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:49.003535 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-0353abde-2053-421b-ab5f-d3d41f49bd82 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:49.004028 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-0353abde-2053-421b-ab5f-d3d41f49bd82 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:49.010047 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0353abde-2053-421b-ab5f-d3d41f49bd82 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:49.010520 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0353abde-2053-421b-ab5f-d3d41f49bd82 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:49.010949 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0353abde-2053-421b-ab5f-d3d41f49bd82 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:49.011624 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0353abde-2053-421b-ab5f-d3d41f49bd82 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:49.012071 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0353abde-2053-421b-ab5f-d3d41f49bd82 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:49.012487 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0353abde-2053-421b-ab5f-d3d41f49bd82 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:49.041557 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-0353abde-2053-421b-ab5f-d3d41f49bd82 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Going to try to terminate instance {{(pid=127284) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:33:49.069258 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:33:49.124042 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-0353abde-2053-421b-ab5f-d3d41f49bd82 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "DELETE /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 204 len: 0 microversion: 2.1 time: 0.124135 Aug 19 16:33:49.124623 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 169/336] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:33:48 2022] DELETE /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:33:49.133282 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-297f78ce-31f9-4f4a-ba47-1c41e077653d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:49.133939 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-297f78ce-31f9-4f4a-ba47-1c41e077653d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:49.139931 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-297f78ce-31f9-4f4a-ba47-1c41e077653d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:49.140410 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-297f78ce-31f9-4f4a-ba47-1c41e077653d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:49.140905 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-297f78ce-31f9-4f4a-ba47-1c41e077653d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:49.141601 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-297f78ce-31f9-4f4a-ba47-1c41e077653d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:49.142056 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-297f78ce-31f9-4f4a-ba47-1c41e077653d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:49.142482 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-297f78ce-31f9-4f4a-ba47-1c41e077653d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:49.268155 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-297f78ce-31f9-4f4a-ba47-1c41e077653d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:49.276412 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-297f78ce-31f9-4f4a-ba47-1c41e077653d tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 200 len: 1503 microversion: 2.1 time: 0.147510 Aug 19 16:33:49.277008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 168/337] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:49 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:49.349176 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-dd042633-9fac-43af-bf72-8d9e370f72fc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:49.350502 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-dd042633-9fac-43af-bf72-8d9e370f72fc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:49.357666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd042633-9fac-43af-bf72-8d9e370f72fc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:49.358152 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd042633-9fac-43af-bf72-8d9e370f72fc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:49.358617 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd042633-9fac-43af-bf72-8d9e370f72fc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:49.359345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd042633-9fac-43af-bf72-8d9e370f72fc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:49.359792 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd042633-9fac-43af-bf72-8d9e370f72fc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:49.360209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd042633-9fac-43af-bf72-8d9e370f72fc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:49.489685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-dd042633-9fac-43af-bf72-8d9e370f72fc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:49.497375 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-dd042633-9fac-43af-bf72-8d9e370f72fc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.152470 Aug 19 16:33:49.497949 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 170/338] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:49 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:49.893168 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-bb4efbbb-ce40-4964-8765-4004ad66ad77 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:49.893779 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-bb4efbbb-ce40-4964-8765-4004ad66ad77 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:49.899774 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bb4efbbb-ce40-4964-8765-4004ad66ad77 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:49.900253 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bb4efbbb-ce40-4964-8765-4004ad66ad77 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:49.900683 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bb4efbbb-ce40-4964-8765-4004ad66ad77 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:49.901393 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bb4efbbb-ce40-4964-8765-4004ad66ad77 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:49.901841 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bb4efbbb-ce40-4964-8765-4004ad66ad77 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:49.902256 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bb4efbbb-ce40-4964-8765-4004ad66ad77 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:50.035071 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-bb4efbbb-ce40-4964-8765-4004ad66ad77 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:50.043091 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-bb4efbbb-ce40-4964-8765-4004ad66ad77 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1319 microversion: 2.1 time: 0.153724 Aug 19 16:33:50.043648 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 169/339] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:49 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:50.298002 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d8d1a7b7-7d0d-41c3-ae1d-8b27db7a4530 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:50.298609 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d8d1a7b7-7d0d-41c3-ae1d-8b27db7a4530 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:50.305895 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d8d1a7b7-7d0d-41c3-ae1d-8b27db7a4530 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:50.306375 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d8d1a7b7-7d0d-41c3-ae1d-8b27db7a4530 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:50.306806 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d8d1a7b7-7d0d-41c3-ae1d-8b27db7a4530 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:50.307486 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d8d1a7b7-7d0d-41c3-ae1d-8b27db7a4530 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:50.307934 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d8d1a7b7-7d0d-41c3-ae1d-8b27db7a4530 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:50.308351 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d8d1a7b7-7d0d-41c3-ae1d-8b27db7a4530 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:50.433912 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d8d1a7b7-7d0d-41c3-ae1d-8b27db7a4530 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:50.441451 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d8d1a7b7-7d0d-41c3-ae1d-8b27db7a4530 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 200 len: 1503 microversion: 2.1 time: 0.147327 Aug 19 16:33:50.442015 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 171/340] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:50 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:50.518215 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6e41bb07-1931-48af-ad54-6db48a1ba212 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:50.518850 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6e41bb07-1931-48af-ad54-6db48a1ba212 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:50.525688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e41bb07-1931-48af-ad54-6db48a1ba212 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:50.526170 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e41bb07-1931-48af-ad54-6db48a1ba212 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:50.526606 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e41bb07-1931-48af-ad54-6db48a1ba212 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:50.527296 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e41bb07-1931-48af-ad54-6db48a1ba212 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:50.527752 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e41bb07-1931-48af-ad54-6db48a1ba212 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:50.528176 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e41bb07-1931-48af-ad54-6db48a1ba212 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:50.618230 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-3893f662-7eb4-42bf-bc62-43cf328a3558 req-d242e3da-9f89-40e7-8490-2ce5de392004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38a84b78-4b40-4cfe-b649-528c7dad0f32", "name": "network-vif-plugged", "status": "completed", "tag": "78290210-89a1-48d0-a016-f3d5096766a8"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:33:50.629403 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-3893f662-7eb4-42bf-bc62-43cf328a3558 req-d242e3da-9f89-40e7-8490-2ce5de392004 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:50.629877 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-3893f662-7eb4-42bf-bc62-43cf328a3558 req-d242e3da-9f89-40e7-8490-2ce5de392004 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:50.630298 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-3893f662-7eb4-42bf-bc62-43cf328a3558 req-d242e3da-9f89-40e7-8490-2ce5de392004 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:50.643284 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-3893f662-7eb4-42bf-bc62-43cf328a3558 req-d242e3da-9f89-40e7-8490-2ce5de392004 service nova] Creating event network-vif-plugged:78290210-89a1-48d0-a016-f3d5096766a8 for instance 38a84b78-4b40-4cfe-b649-528c7dad0f32 on hv-cinder-83124 Aug 19 16:33:50.648924 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-3893f662-7eb4-42bf-bc62-43cf328a3558 req-d242e3da-9f89-40e7-8490-2ce5de392004 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034842 Aug 19 16:33:50.649764 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 172/341] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:33:50.668612 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6e41bb07-1931-48af-ad54-6db48a1ba212 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:50.676684 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6e41bb07-1931-48af-ad54-6db48a1ba212 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.162212 Aug 19 16:33:50.677300 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 170/342] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:50 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:51.065117 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-da82ef2b-6200-4bcf-b67e-abd1eaf8b997 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:51.065808 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-da82ef2b-6200-4bcf-b67e-abd1eaf8b997 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:51.072346 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-da82ef2b-6200-4bcf-b67e-abd1eaf8b997 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:51.072849 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-da82ef2b-6200-4bcf-b67e-abd1eaf8b997 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:51.073362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-da82ef2b-6200-4bcf-b67e-abd1eaf8b997 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:51.074055 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-da82ef2b-6200-4bcf-b67e-abd1eaf8b997 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:51.074503 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-da82ef2b-6200-4bcf-b67e-abd1eaf8b997 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:51.074922 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-da82ef2b-6200-4bcf-b67e-abd1eaf8b997 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:51.212877 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-da82ef2b-6200-4bcf-b67e-abd1eaf8b997 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:51.220558 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-da82ef2b-6200-4bcf-b67e-abd1eaf8b997 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1319 microversion: 2.1 time: 0.159587 Aug 19 16:33:51.221021 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 173/343] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:51 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:51.463556 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-eac36bb1-b46e-44d1-8e3f-79b4f7b3df79 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:51.464190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-eac36bb1-b46e-44d1-8e3f-79b4f7b3df79 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:51.470197 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-eac36bb1-b46e-44d1-8e3f-79b4f7b3df79 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:51.470692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-eac36bb1-b46e-44d1-8e3f-79b4f7b3df79 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:51.471116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-eac36bb1-b46e-44d1-8e3f-79b4f7b3df79 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:51.471800 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-eac36bb1-b46e-44d1-8e3f-79b4f7b3df79 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:51.472257 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-eac36bb1-b46e-44d1-8e3f-79b4f7b3df79 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:51.472690 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-eac36bb1-b46e-44d1-8e3f-79b4f7b3df79 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:51.600542 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-eac36bb1-b46e-44d1-8e3f-79b4f7b3df79 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:51.608582 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-eac36bb1-b46e-44d1-8e3f-79b4f7b3df79 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 200 len: 1503 microversion: 2.1 time: 0.148980 Aug 19 16:33:51.609169 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 171/344] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:51 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:51.698355 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-35d56ed0-c076-400e-9591-1d61abfa57a5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:51.699209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-35d56ed0-c076-400e-9591-1d61abfa57a5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:51.707377 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35d56ed0-c076-400e-9591-1d61abfa57a5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:51.707867 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35d56ed0-c076-400e-9591-1d61abfa57a5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:51.708609 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35d56ed0-c076-400e-9591-1d61abfa57a5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:51.709326 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35d56ed0-c076-400e-9591-1d61abfa57a5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:51.709834 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35d56ed0-c076-400e-9591-1d61abfa57a5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:51.710409 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35d56ed0-c076-400e-9591-1d61abfa57a5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:51.848652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-35d56ed0-c076-400e-9591-1d61abfa57a5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:51.856935 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-35d56ed0-c076-400e-9591-1d61abfa57a5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.162531 Aug 19 16:33:51.857561 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 174/345] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:51 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:52.241184 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8107722b-7b9b-4cee-ad74-2d1489535c61 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:52.241876 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8107722b-7b9b-4cee-ad74-2d1489535c61 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:52.247692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8107722b-7b9b-4cee-ad74-2d1489535c61 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:52.248171 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8107722b-7b9b-4cee-ad74-2d1489535c61 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:52.248600 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8107722b-7b9b-4cee-ad74-2d1489535c61 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:52.249299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8107722b-7b9b-4cee-ad74-2d1489535c61 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:52.249749 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8107722b-7b9b-4cee-ad74-2d1489535c61 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:52.250170 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8107722b-7b9b-4cee-ad74-2d1489535c61 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:52.428086 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-8107722b-7b9b-4cee-ad74-2d1489535c61 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:52.436104 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8107722b-7b9b-4cee-ad74-2d1489535c61 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1319 microversion: 2.1 time: 0.198716 Aug 19 16:33:52.436673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 172/346] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:52 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:52.555423 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-c83f8d77-d483-4c4a-b697-129c629ae0e9 req-4c7469ba-1e65-4943-9c6e-e2dc8cf4b39a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "082cc16e-016a-4784-8c10-dd93060f3b63", "name": "network-vif-deleted", "tag": "183cc255-8e84-4291-8cd3-450c3a6ad74a"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:33:52.565473 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-c83f8d77-d483-4c4a-b697-129c629ae0e9 req-4c7469ba-1e65-4943-9c6e-e2dc8cf4b39a service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:52.565978 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-c83f8d77-d483-4c4a-b697-129c629ae0e9 req-4c7469ba-1e65-4943-9c6e-e2dc8cf4b39a service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:52.566410 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-c83f8d77-d483-4c4a-b697-129c629ae0e9 req-4c7469ba-1e65-4943-9c6e-e2dc8cf4b39a service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:52.578994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-c83f8d77-d483-4c4a-b697-129c629ae0e9 req-4c7469ba-1e65-4943-9c6e-e2dc8cf4b39a service nova] Creating event network-vif-deleted:183cc255-8e84-4291-8cd3-450c3a6ad74a for instance 082cc16e-016a-4784-8c10-dd93060f3b63 on hv-cinder-83124 Aug 19 16:33:52.584474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-c83f8d77-d483-4c4a-b697-129c629ae0e9 req-4c7469ba-1e65-4943-9c6e-e2dc8cf4b39a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032694 Aug 19 16:33:52.585702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 175/347] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:33:52.631151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-bf4bebc8-0d22-4db0-a337-693b8f126589 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:52.632367 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-bf4bebc8-0d22-4db0-a337-693b8f126589 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:52.638954 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bf4bebc8-0d22-4db0-a337-693b8f126589 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:52.639418 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bf4bebc8-0d22-4db0-a337-693b8f126589 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:52.639885 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bf4bebc8-0d22-4db0-a337-693b8f126589 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:52.640821 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bf4bebc8-0d22-4db0-a337-693b8f126589 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:52.641286 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bf4bebc8-0d22-4db0-a337-693b8f126589 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:52.641766 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bf4bebc8-0d22-4db0-a337-693b8f126589 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:52.705979 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-bf4bebc8-0d22-4db0-a337-693b8f126589 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:52.714543 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-bf4bebc8-0d22-4db0-a337-693b8f126589 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 200 len: 1461 microversion: 2.1 time: 0.087398 Aug 19 16:33:52.715096 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 173/348] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:52 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 1461 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:52.881533 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8c6f985c-7bc7-4e94-9981-341b534a771f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:52.882800 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8c6f985c-7bc7-4e94-9981-341b534a771f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:52.889418 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8c6f985c-7bc7-4e94-9981-341b534a771f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:52.889962 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8c6f985c-7bc7-4e94-9981-341b534a771f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:52.890340 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8c6f985c-7bc7-4e94-9981-341b534a771f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:52.891031 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8c6f985c-7bc7-4e94-9981-341b534a771f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:52.891558 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8c6f985c-7bc7-4e94-9981-341b534a771f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:52.891983 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8c6f985c-7bc7-4e94-9981-341b534a771f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:53.028227 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8c6f985c-7bc7-4e94-9981-341b534a771f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:53.035785 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8c6f985c-7bc7-4e94-9981-341b534a771f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.160645 Aug 19 16:33:53.036341 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 176/349] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:52 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:53.458195 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a04ee868-d2a6-41a1-9589-d4f4c506eab5 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:53.459072 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a04ee868-d2a6-41a1-9589-d4f4c506eab5 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:53.465046 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a04ee868-d2a6-41a1-9589-d4f4c506eab5 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:53.465531 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a04ee868-d2a6-41a1-9589-d4f4c506eab5 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:53.465962 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a04ee868-d2a6-41a1-9589-d4f4c506eab5 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:53.466656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a04ee868-d2a6-41a1-9589-d4f4c506eab5 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:53.467110 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a04ee868-d2a6-41a1-9589-d4f4c506eab5 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:53.467539 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a04ee868-d2a6-41a1-9589-d4f4c506eab5 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:53.598691 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a04ee868-d2a6-41a1-9589-d4f4c506eab5 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:53.607157 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a04ee868-d2a6-41a1-9589-d4f4c506eab5 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1319 microversion: 2.1 time: 0.153141 Aug 19 16:33:53.607725 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 174/350] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:53 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:33:53.736453 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e742bd64-f6a4-4fcf-9cb5-902743bea70c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:53.737981 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-e742bd64-f6a4-4fcf-9cb5-902743bea70c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:53.744288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e742bd64-f6a4-4fcf-9cb5-902743bea70c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:53.744927 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e742bd64-f6a4-4fcf-9cb5-902743bea70c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:53.745457 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e742bd64-f6a4-4fcf-9cb5-902743bea70c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:53.746213 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e742bd64-f6a4-4fcf-9cb5-902743bea70c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:53.746751 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e742bd64-f6a4-4fcf-9cb5-902743bea70c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:53.747232 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e742bd64-f6a4-4fcf-9cb5-902743bea70c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:53.778729 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e742bd64-f6a4-4fcf-9cb5-902743bea70c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:53.779211 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e742bd64-f6a4-4fcf-9cb5-902743bea70c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:53.779640 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e742bd64-f6a4-4fcf-9cb5-902743bea70c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:53.780079 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.objects.instance [None req-e742bd64-f6a4-4fcf-9cb5-902743bea70c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lazy-loading 'fault' on Instance uuid 082cc16e-016a-4784-8c10-dd93060f3b63 {{(pid=127284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:33:53.821215 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e742bd64-f6a4-4fcf-9cb5-902743bea70c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:53.828920 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e742bd64-f6a4-4fcf-9cb5-902743bea70c tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 200 len: 1303 microversion: 2.1 time: 0.097069 Aug 19 16:33:53.829480 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 177/351] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:53 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:54.056496 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-029d203f-c0e1-4782-963e-eb399b7efb77 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:54.057138 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-029d203f-c0e1-4782-963e-eb399b7efb77 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:54.063083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-029d203f-c0e1-4782-963e-eb399b7efb77 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:54.063566 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-029d203f-c0e1-4782-963e-eb399b7efb77 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:54.064010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-029d203f-c0e1-4782-963e-eb399b7efb77 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:54.064702 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-029d203f-c0e1-4782-963e-eb399b7efb77 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:54.065186 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-029d203f-c0e1-4782-963e-eb399b7efb77 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:54.065616 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-029d203f-c0e1-4782-963e-eb399b7efb77 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:54.194642 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-029d203f-c0e1-4782-963e-eb399b7efb77 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:54.202395 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-029d203f-c0e1-4782-963e-eb399b7efb77 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.149839 Aug 19 16:33:54.202954 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 175/352] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:54 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:54.627377 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ecc9a91b-f338-4172-90a7-b8b16c19c3c4 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:54.627997 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ecc9a91b-f338-4172-90a7-b8b16c19c3c4 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:54.635254 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ecc9a91b-f338-4172-90a7-b8b16c19c3c4 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:54.635733 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ecc9a91b-f338-4172-90a7-b8b16c19c3c4 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:54.636165 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ecc9a91b-f338-4172-90a7-b8b16c19c3c4 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:54.636887 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ecc9a91b-f338-4172-90a7-b8b16c19c3c4 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:54.637364 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ecc9a91b-f338-4172-90a7-b8b16c19c3c4 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:54.637783 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ecc9a91b-f338-4172-90a7-b8b16c19c3c4 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:54.763761 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ecc9a91b-f338-4172-90a7-b8b16c19c3c4 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:54.771327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ecc9a91b-f338-4172-90a7-b8b16c19c3c4 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1319 microversion: 2.1 time: 0.147804 Aug 19 16:33:54.771894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 178/353] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:54 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:54.850755 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-7f2122a9-74ba-4e73-b3ab-09fdd71d72ef tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:54.851520 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-7f2122a9-74ba-4e73-b3ab-09fdd71d72ef tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:54.857495 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f2122a9-74ba-4e73-b3ab-09fdd71d72ef tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:54.857980 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f2122a9-74ba-4e73-b3ab-09fdd71d72ef tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:54.858420 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f2122a9-74ba-4e73-b3ab-09fdd71d72ef tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:54.859105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f2122a9-74ba-4e73-b3ab-09fdd71d72ef tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:54.859563 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f2122a9-74ba-4e73-b3ab-09fdd71d72ef tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:54.859995 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f2122a9-74ba-4e73-b3ab-09fdd71d72ef tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:54.889735 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f2122a9-74ba-4e73-b3ab-09fdd71d72ef tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:54.890235 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f2122a9-74ba-4e73-b3ab-09fdd71d72ef tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:54.890666 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f2122a9-74ba-4e73-b3ab-09fdd71d72ef tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:54.891107 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.objects.instance [None req-7f2122a9-74ba-4e73-b3ab-09fdd71d72ef tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lazy-loading 'fault' on Instance uuid 082cc16e-016a-4784-8c10-dd93060f3b63 {{(pid=127285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:33:54.934559 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7f2122a9-74ba-4e73-b3ab-09fdd71d72ef tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:54.942141 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-7f2122a9-74ba-4e73-b3ab-09fdd71d72ef tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 200 len: 1303 microversion: 2.1 time: 0.095819 Aug 19 16:33:54.942693 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 176/354] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:54 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:55.230352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-88921ef6-daec-431d-8bf9-111a3f9054df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:55.230963 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-88921ef6-daec-431d-8bf9-111a3f9054df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:55.236934 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-88921ef6-daec-431d-8bf9-111a3f9054df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:55.237377 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-88921ef6-daec-431d-8bf9-111a3f9054df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:55.237810 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-88921ef6-daec-431d-8bf9-111a3f9054df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:55.238492 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-88921ef6-daec-431d-8bf9-111a3f9054df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:55.238967 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-88921ef6-daec-431d-8bf9-111a3f9054df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:55.239382 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-88921ef6-daec-431d-8bf9-111a3f9054df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:55.373310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-88921ef6-daec-431d-8bf9-111a3f9054df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:55.380831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-88921ef6-daec-431d-8bf9-111a3f9054df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.160119 Aug 19 16:33:55.381916 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 179/355] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:55 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:55.791477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-59800b7e-b568-4c60-9bf4-5b30ed4bc28d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:55.792080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-59800b7e-b568-4c60-9bf4-5b30ed4bc28d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:55.797966 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-59800b7e-b568-4c60-9bf4-5b30ed4bc28d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:55.798438 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-59800b7e-b568-4c60-9bf4-5b30ed4bc28d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:55.798865 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-59800b7e-b568-4c60-9bf4-5b30ed4bc28d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:55.799535 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-59800b7e-b568-4c60-9bf4-5b30ed4bc28d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:55.799980 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-59800b7e-b568-4c60-9bf4-5b30ed4bc28d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:55.800396 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-59800b7e-b568-4c60-9bf4-5b30ed4bc28d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:55.930447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-59800b7e-b568-4c60-9bf4-5b30ed4bc28d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:55.938163 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-59800b7e-b568-4c60-9bf4-5b30ed4bc28d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1509 microversion: 2.1 time: 0.150660 Aug 19 16:33:55.938712 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 177/356] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:55 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:55.963371 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-408b95fa-51d1-4096-8fa5-0cccf0a60374 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:55.963971 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-408b95fa-51d1-4096-8fa5-0cccf0a60374 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:55.970311 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-408b95fa-51d1-4096-8fa5-0cccf0a60374 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:55.970795 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-408b95fa-51d1-4096-8fa5-0cccf0a60374 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:55.971226 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-408b95fa-51d1-4096-8fa5-0cccf0a60374 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:55.971916 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-408b95fa-51d1-4096-8fa5-0cccf0a60374 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:55.972365 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-408b95fa-51d1-4096-8fa5-0cccf0a60374 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:55.972800 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-408b95fa-51d1-4096-8fa5-0cccf0a60374 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:56.004440 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-408b95fa-51d1-4096-8fa5-0cccf0a60374 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:56.004950 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-408b95fa-51d1-4096-8fa5-0cccf0a60374 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:56.005381 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-408b95fa-51d1-4096-8fa5-0cccf0a60374 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:56.005818 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.objects.instance [None req-408b95fa-51d1-4096-8fa5-0cccf0a60374 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lazy-loading 'fault' on Instance uuid 082cc16e-016a-4784-8c10-dd93060f3b63 {{(pid=127284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:33:56.048287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-408b95fa-51d1-4096-8fa5-0cccf0a60374 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:56.057405 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-408b95fa-51d1-4096-8fa5-0cccf0a60374 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 200 len: 1303 microversion: 2.1 time: 0.097868 Aug 19 16:33:56.057974 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 180/357] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:55 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:56.407164 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f0cb9e23-2ba7-406f-942f-29c0cef17a2b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:56.408736 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f0cb9e23-2ba7-406f-942f-29c0cef17a2b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:56.418169 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f0cb9e23-2ba7-406f-942f-29c0cef17a2b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:56.419153 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f0cb9e23-2ba7-406f-942f-29c0cef17a2b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:56.419937 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f0cb9e23-2ba7-406f-942f-29c0cef17a2b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:56.420928 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f0cb9e23-2ba7-406f-942f-29c0cef17a2b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:56.421600 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f0cb9e23-2ba7-406f-942f-29c0cef17a2b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:56.422317 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f0cb9e23-2ba7-406f-942f-29c0cef17a2b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:56.587558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f0cb9e23-2ba7-406f-942f-29c0cef17a2b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:56.596611 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f0cb9e23-2ba7-406f-942f-29c0cef17a2b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.195570 Aug 19 16:33:56.608861 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 178/358] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:56 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:57.078917 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8f77c6ee-2cbb-4607-902c-dccd86c6d392 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:57.079648 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8f77c6ee-2cbb-4607-902c-dccd86c6d392 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:57.086981 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f77c6ee-2cbb-4607-902c-dccd86c6d392 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:57.087560 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f77c6ee-2cbb-4607-902c-dccd86c6d392 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:57.087953 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f77c6ee-2cbb-4607-902c-dccd86c6d392 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:57.088644 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f77c6ee-2cbb-4607-902c-dccd86c6d392 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:57.089122 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f77c6ee-2cbb-4607-902c-dccd86c6d392 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:57.089632 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f77c6ee-2cbb-4607-902c-dccd86c6d392 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:57.120913 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f77c6ee-2cbb-4607-902c-dccd86c6d392 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:57.121318 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f77c6ee-2cbb-4607-902c-dccd86c6d392 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:57.121748 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8f77c6ee-2cbb-4607-902c-dccd86c6d392 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:57.122193 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.objects.instance [None req-8f77c6ee-2cbb-4607-902c-dccd86c6d392 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lazy-loading 'fault' on Instance uuid 082cc16e-016a-4784-8c10-dd93060f3b63 {{(pid=127284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:33:57.167747 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8f77c6ee-2cbb-4607-902c-dccd86c6d392 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7536a92033384383bd625b6c969ebd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a549f3d5fb9443409faa06cf7b00d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:57.175645 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8f77c6ee-2cbb-4607-902c-dccd86c6d392 tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 200 len: 1303 microversion: 2.1 time: 0.100832 Aug 19 16:33:57.176218 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 181/359] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:57 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:57.620814 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-45a94cec-2b43-440b-8f81-cec9643fce27 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:57.621544 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-45a94cec-2b43-440b-8f81-cec9643fce27 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:57.627749 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-45a94cec-2b43-440b-8f81-cec9643fce27 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:57.628270 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-45a94cec-2b43-440b-8f81-cec9643fce27 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:57.628788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-45a94cec-2b43-440b-8f81-cec9643fce27 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:57.629399 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-45a94cec-2b43-440b-8f81-cec9643fce27 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:57.629884 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-45a94cec-2b43-440b-8f81-cec9643fce27 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:57.630276 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-45a94cec-2b43-440b-8f81-cec9643fce27 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:57.716273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-30b5a624-7a2f-4fe9-9390-203f3b27370b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:57.716850 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-30b5a624-7a2f-4fe9-9390-203f3b27370b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:57.722907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-30b5a624-7a2f-4fe9-9390-203f3b27370b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:57.723396 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-30b5a624-7a2f-4fe9-9390-203f3b27370b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:57.723825 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-30b5a624-7a2f-4fe9-9390-203f3b27370b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:57.724510 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-30b5a624-7a2f-4fe9-9390-203f3b27370b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:57.725185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-30b5a624-7a2f-4fe9-9390-203f3b27370b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:57.725829 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-30b5a624-7a2f-4fe9-9390-203f3b27370b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:57.765691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-30b5a624-7a2f-4fe9-9390-203f3b27370b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8/ips" status: 200 len: 152 microversion: 2.20 time: 0.053238 Aug 19 16:33:57.766456 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 182/360] 10.222.0.55 () {60 vars in 1289 bytes} [Fri Aug 19 16:33:57 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8/ips => generated 152 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:33:57.771339 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-45a94cec-2b43-440b-8f81-cec9643fce27 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:57.780869 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-45a94cec-2b43-440b-8f81-cec9643fce27 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.164730 Aug 19 16:33:57.781442 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 179/361] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:57 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:58.197641 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1d4b36a8-ef06-43ac-b5f7-72d3ac7a5b3b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:58.198254 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1d4b36a8-ef06-43ac-b5f7-72d3ac7a5b3b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] [instance: 082cc16e-016a-4784-8c10-dd93060f3b63] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:58.204919 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1d4b36a8-ef06-43ac-b5f7-72d3ac7a5b3b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:58.205403 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1d4b36a8-ef06-43ac-b5f7-72d3ac7a5b3b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:58.205837 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1d4b36a8-ef06-43ac-b5f7-72d3ac7a5b3b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:58.206523 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1d4b36a8-ef06-43ac-b5f7-72d3ac7a5b3b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:58.207232 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1d4b36a8-ef06-43ac-b5f7-72d3ac7a5b3b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:58.207736 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1d4b36a8-ef06-43ac-b5f7-72d3ac7a5b3b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:58.221435 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-1d4b36a8-ef06-43ac-b5f7-72d3ac7a5b3b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] HTTP exception thrown: Instance 082cc16e-016a-4784-8c10-dd93060f3b63 could not be found. Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1d4b36a8-ef06-43ac-b5f7-72d3ac7a5b3b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Request method failure captured: Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 HTTP/1.1 Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7sposr7f5KUP_1-dMGsybC4dHG7F-QwF0LZrHj_JoanU8M2NIKbxrSitLzzkrnFRrjDqC0IVHiKZPP9trQqyWfuGORUQkKRkdzACF-fdn04UMJZZHQyzE5z44092YBXOohl9jq8i8tXE8krhQ7CeHDzQJOHIXZrb81yJGOW6BXZqcY Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: a549f3d5fb9443409faa06cf7b00d8ca Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-VolumesActionsTest-736109715 Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:33:58.223070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:33:58.224450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a549f3d5fb9443409faa06cf7b00d8ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a549f3d5fb9443409faa06cf7b00d8ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a549f3d5fb9443409faa06cf7b00d8ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a549f3d5fb9443409faa06cf7b00d8ca"}]}] Aug 19 16:33:58.224450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-VolumesActionsTest-736109715 Aug 19 16:33:58.224450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: a549f3d5fb9443409faa06cf7b00d8ca Aug 19 16:33:58.224450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-VolumesActionsTest-736109715 Aug 19 16:33:58.224450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-VolumesActionsTest-736109715-project Aug 19 16:33:58.224450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:33:58.224450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:33:58.224450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: 7536a92033384383bd625b6c969ebd38 Aug 19 16:33:58.224450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-VolumesActionsTest-736109715-project Aug 19 16:33:58.224450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:33:58.224450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance 082cc16e-016a-4784-8c10-dd93060f3b63 could not be found. Aug 19 16:33:58.224450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': '082cc16e-016a-4784-8c10-dd93060f3b63'} Aug 19 16:33:58.225295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:33:58.225295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:58.225295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:33:58.225295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:33:58.225295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:33:58.225295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:33:58.225295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:33:58.225295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:33:58.225295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:33:58.225295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:33:58.225295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 082cc16e-016a-4784-8c10-dd93060f3b63 could not be found. Aug 19 16:33:58.225295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:58.225295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:33:58.225295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:58.225295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:58.225295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:33:58.225295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:33:58.225295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:33:58.225295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:33:58.225295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:33:58.226652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:33:58.226652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:33:58.226652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:33:58.226652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:33:58.226652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:33:58.226652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:33:58.226652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:33:58.226652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 082cc16e-016a-4784-8c10-dd93060f3b63 could not be found. Aug 19 16:33:58.226652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:58.226652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:33:58.226652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:58.226652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:58.226652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:33:58.226652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:33:58.226652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:33:58.226652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:33:58.226652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 082cc16e-016a-4784-8c10-dd93060f3b63 could not be found. Aug 19 16:33:58.226652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:58.227805 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1d4b36a8-ef06-43ac-b5f7-72d3ac7a5b3b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] Returning 404 to user: Instance 082cc16e-016a-4784-8c10-dd93060f3b63 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:33:58.227805 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1d4b36a8-ef06-43ac-b5f7-72d3ac7a5b3b tempest-VolumesActionsTest-736109715 tempest-VolumesActionsTest-736109715-project] 10.222.0.55 "GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63" status: 404 len: 111 microversion: 2.1 time: 0.031391 Aug 19 16:33:58.228145 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 183/362] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:58 2022] GET /compute/v2.1/servers/082cc16e-016a-4784-8c10-dd93060f3b63 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:33:58.802136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1105d6ac-276e-47ea-95d4-67f6b1fc09a3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:58.802886 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-1105d6ac-276e-47ea-95d4-67f6b1fc09a3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:58.809427 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1105d6ac-276e-47ea-95d4-67f6b1fc09a3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:58.809892 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1105d6ac-276e-47ea-95d4-67f6b1fc09a3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:58.810328 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1105d6ac-276e-47ea-95d4-67f6b1fc09a3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:58.811008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1105d6ac-276e-47ea-95d4-67f6b1fc09a3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:58.811466 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1105d6ac-276e-47ea-95d4-67f6b1fc09a3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:58.811887 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1105d6ac-276e-47ea-95d4-67f6b1fc09a3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:58.943894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1105d6ac-276e-47ea-95d4-67f6b1fc09a3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:58.952022 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-1105d6ac-276e-47ea-95d4-67f6b1fc09a3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1501 microversion: 2.1 time: 0.153627 Aug 19 16:33:58.952577 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 180/363] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:58 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:33:58.975538 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-dbc992bb-c3a3-454e-bc2c-530d6fe41884 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd5d6248-59b3-4fa7-b9c4-b3613b01c95d"}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:33:58.977995 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-dbc992bb-c3a3-454e-bc2c-530d6fe41884 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:58.983776 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dbc992bb-c3a3-454e-bc2c-530d6fe41884 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:58.984255 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dbc992bb-c3a3-454e-bc2c-530d6fe41884 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:58.984683 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dbc992bb-c3a3-454e-bc2c-530d6fe41884 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:58.985391 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dbc992bb-c3a3-454e-bc2c-530d6fe41884 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:58.985834 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dbc992bb-c3a3-454e-bc2c-530d6fe41884 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:58.986421 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dbc992bb-c3a3-454e-bc2c-530d6fe41884 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:59.008708 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-dbc992bb-c3a3-454e-bc2c-530d6fe41884 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] HTTP exception thrown: Cannot 'attach_volume' instance 73fc9558-1f91-4cbd-b5f1-9342dc7d6148 while it is in vm_state rescued Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-dbc992bb-c3a3-454e-bc2c-530d6fe41884 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Request method failure captured: Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: POST /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148/os-volume_attachments HTTP/1.1 Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 74 Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7sC2YMsastFwF5KHrblHGiieD2S6sdzYymMS54J0x8Vt4lT84xG-4lz_ihMmAVoylGBgEjsioBmjrEY0M57P2KMvM72KxZwA4DIrU64AxkuAJ1z0DkabuEtOI2EukBYULCeMuCjhjcFFPoj2rUEBN2R8sCo70cp1AnirNniwWFQth0 Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: b5638f78ab9440479a209d0023e6d0bd Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1328462527 Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:33:59.010327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:33:59.011773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b5638f78ab9440479a209d0023e6d0bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5638f78ab9440479a209d0023e6d0bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5638f78ab9440479a209d0023e6d0bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b5638f78ab9440479a209d0023e6d0bd"}]}] Aug 19 16:33:59.011773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1328462527 Aug 19 16:33:59.011773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: b5638f78ab9440479a209d0023e6d0bd Aug 19 16:33:59.011773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1328462527 Aug 19 16:33:59.011773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-ServerRescueNegativeTestJSON-1328462527-project Aug 19 16:33:59.011773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:33:59.011773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:33:59.011773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: 7936bf23a031418b8ce304aa3bbcf8a2 Aug 19 16:33:59.011773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1328462527-project Aug 19 16:33:59.011773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Aug 19 16:33:59.011773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {"volumeAttachment": {"volumeId": "fd5d6248-59b3-4fa7-b9c4-b3613b01c95d"}} Aug 19 16:33:59.011773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:33:59.012739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Cannot 'attach_volume' instance 73fc9558-1f91-4cbd-b5f1-9342dc7d6148 while it is in vm_state rescued Aug 19 16:33:59.012739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'server_id': '73fc9558-1f91-4cbd-b5f1-9342dc7d6148', 'body': {'volumeAttachment': {'volumeId': 'fd5d6248-59b3-4fa7-b9c4-b3613b01c95d'}}} Aug 19 16:33:59.012739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:33:59.012739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:59.012739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 19 16:33:59.012739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 19 16:33:59.012739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 19 16:33:59.012739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 19 16:33:59.012739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 19 16:33:59.012739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 19 16:33:59.012739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 73fc9558-1f91-4cbd-b5f1-9342dc7d6148 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 19 16:33:59.012739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:59.012739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:33:59.012739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:59.012739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:59.012739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:33:59.012739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:33:59.012739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:33:59.012739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:33:59.014315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:33:59.014315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:33:59.014315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 16:33:59.014315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 16:33:59.014315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 16:33:59.014315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 16:33:59.014315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 16:33:59.014315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 16:33:59.014315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 19 16:33:59.014315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 19 16:33:59.014315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 19 16:33:59.014315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 19 16:33:59.014315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 73fc9558-1f91-4cbd-b5f1-9342dc7d6148 while it is in vm_state rescued Aug 19 16:33:59.014315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:59.014315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:33:59.014315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:59.014315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:33:59.014315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:33:59.014315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:33:59.015616 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:33:59.015616 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:33:59.015616 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 73fc9558-1f91-4cbd-b5f1-9342dc7d6148 while it is in vm_state rescued Aug 19 16:33:59.015616 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:33:59.015616 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-dbc992bb-c3a3-454e-bc2c-530d6fe41884 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Returning 409 to user: Cannot 'attach_volume' instance 73fc9558-1f91-4cbd-b5f1-9342dc7d6148 while it is in vm_state rescued {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:33:59.015616 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-dbc992bb-c3a3-454e-bc2c-530d6fe41884 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "POST /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040781 Aug 19 16:33:59.016359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 184/364] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Aug 19 16:33:58 2022] POST /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 19 16:33:59.021080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4b0d68c0-e4cd-4626-8b11-9044e6400fa3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:33:59.021615 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-4b0d68c0-e4cd-4626-8b11-9044e6400fa3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:59.028065 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4b0d68c0-e4cd-4626-8b11-9044e6400fa3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:59.028544 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4b0d68c0-e4cd-4626-8b11-9044e6400fa3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:59.029010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4b0d68c0-e4cd-4626-8b11-9044e6400fa3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:59.029694 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4b0d68c0-e4cd-4626-8b11-9044e6400fa3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:59.030143 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4b0d68c0-e4cd-4626-8b11-9044e6400fa3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:59.030566 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4b0d68c0-e4cd-4626-8b11-9044e6400fa3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:59.093770 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4b0d68c0-e4cd-4626-8b11-9044e6400fa3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "POST /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148/action" status: 202 len: 0 microversion: 2.1 time: 0.076406 Aug 19 16:33:59.094393 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 181/365] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Aug 19 16:33:59 2022] POST /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 19 16:33:59.103204 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8b654b94-add5-49c4-978b-b426f0906b2b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:33:59.103938 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8b654b94-add5-49c4-978b-b426f0906b2b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:33:59.109843 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b654b94-add5-49c4-978b-b426f0906b2b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:59.110313 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b654b94-add5-49c4-978b-b426f0906b2b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:59.110744 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b654b94-add5-49c4-978b-b426f0906b2b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:59.111420 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b654b94-add5-49c4-978b-b426f0906b2b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:33:59.111862 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b654b94-add5-49c4-978b-b426f0906b2b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:33:59.112280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b654b94-add5-49c4-978b-b426f0906b2b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:33:59.260821 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8b654b94-add5-49c4-978b-b426f0906b2b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:33:59.269479 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8b654b94-add5-49c4-978b-b426f0906b2b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1509 microversion: 2.1 time: 0.170642 Aug 19 16:33:59.272638 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 185/366] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:33:59 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:00.293190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2c93d0b6-206b-49e4-ae86-9688c10d5bf6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:00.293810 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2c93d0b6-206b-49e4-ae86-9688c10d5bf6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:00.299117 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2d2a1a5d-a05d-4283-b969-c49fa2de0a6d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:34:00.299649 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2d2a1a5d-a05d-4283-b969-c49fa2de0a6d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:00.299916 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2c93d0b6-206b-49e4-ae86-9688c10d5bf6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:00.300398 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2c93d0b6-206b-49e4-ae86-9688c10d5bf6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:00.300853 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2c93d0b6-206b-49e4-ae86-9688c10d5bf6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:00.301540 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2c93d0b6-206b-49e4-ae86-9688c10d5bf6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:00.301986 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2c93d0b6-206b-49e4-ae86-9688c10d5bf6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:00.302402 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2c93d0b6-206b-49e4-ae86-9688c10d5bf6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:00.306163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2d2a1a5d-a05d-4283-b969-c49fa2de0a6d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:00.306644 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2d2a1a5d-a05d-4283-b969-c49fa2de0a6d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:00.307187 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2d2a1a5d-a05d-4283-b969-c49fa2de0a6d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:00.307764 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2d2a1a5d-a05d-4283-b969-c49fa2de0a6d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:00.308216 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2d2a1a5d-a05d-4283-b969-c49fa2de0a6d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:00.308638 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2d2a1a5d-a05d-4283-b969-c49fa2de0a6d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:00.320464 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:34:00.336303 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.objects.instance [None req-2d2a1a5d-a05d-4283-b969-c49fa2de0a6d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lazy-loading 'flavor' on Instance uuid 894cc1e2-8a17-4de0-8127-b929095837d8 {{(pid=127284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:34:00.360888 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:34:00.470865 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2c93d0b6-206b-49e4-ae86-9688c10d5bf6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:00.480110 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2c93d0b6-206b-49e4-ae86-9688c10d5bf6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1509 microversion: 2.1 time: 0.191190 Aug 19 16:34:00.480675 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 182/367] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:00 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:00.532540 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2d2a1a5d-a05d-4283-b969-c49fa2de0a6d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "POST /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8/action" status: 202 len: 0 microversion: 2.20 time: 0.237185 Aug 19 16:34:00.533166 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 186/368] 10.222.0.55 () {62 vars in 1319 bytes} [Fri Aug 19 16:34:00 2022] POST /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 19 16:34:00.542111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-fd30dfdf-c0b3-4059-8b40-8fcdac3d2130 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:00.542757 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-fd30dfdf-c0b3-4059-8b40-8fcdac3d2130 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:00.548654 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fd30dfdf-c0b3-4059-8b40-8fcdac3d2130 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:00.549120 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fd30dfdf-c0b3-4059-8b40-8fcdac3d2130 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:00.549577 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fd30dfdf-c0b3-4059-8b40-8fcdac3d2130 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:00.550257 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fd30dfdf-c0b3-4059-8b40-8fcdac3d2130 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:00.550707 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fd30dfdf-c0b3-4059-8b40-8fcdac3d2130 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:00.551131 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fd30dfdf-c0b3-4059-8b40-8fcdac3d2130 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:00.682731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fd30dfdf-c0b3-4059-8b40-8fcdac3d2130 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:00.691095 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fd30dfdf-c0b3-4059-8b40-8fcdac3d2130 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:00.692582 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fd30dfdf-c0b3-4059-8b40-8fcdac3d2130 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:00.694330 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-fd30dfdf-c0b3-4059-8b40-8fcdac3d2130 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.156270 Aug 19 16:34:00.694877 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 183/369] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:00 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:01.502693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-306f3d83-66d8-4a4e-824a-b21e2a18e1f6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:01.503388 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-306f3d83-66d8-4a4e-824a-b21e2a18e1f6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:01.509875 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-306f3d83-66d8-4a4e-824a-b21e2a18e1f6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:01.510350 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-306f3d83-66d8-4a4e-824a-b21e2a18e1f6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:01.510779 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-306f3d83-66d8-4a4e-824a-b21e2a18e1f6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:01.511468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-306f3d83-66d8-4a4e-824a-b21e2a18e1f6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:01.511917 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-306f3d83-66d8-4a4e-824a-b21e2a18e1f6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:01.512333 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-306f3d83-66d8-4a4e-824a-b21e2a18e1f6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:01.645234 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-306f3d83-66d8-4a4e-824a-b21e2a18e1f6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:01.653297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-306f3d83-66d8-4a4e-824a-b21e2a18e1f6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1509 microversion: 2.1 time: 0.155479 Aug 19 16:34:01.653941 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 187/370] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:01 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:01.717781 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-99382d47-6087-4122-80c1-f6a2c4ca10c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:01.718414 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-99382d47-6087-4122-80c1-f6a2c4ca10c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:01.724360 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-99382d47-6087-4122-80c1-f6a2c4ca10c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:01.725390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-99382d47-6087-4122-80c1-f6a2c4ca10c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:01.725853 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-99382d47-6087-4122-80c1-f6a2c4ca10c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:01.726510 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-99382d47-6087-4122-80c1-f6a2c4ca10c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:01.726961 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-99382d47-6087-4122-80c1-f6a2c4ca10c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:01.727382 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-99382d47-6087-4122-80c1-f6a2c4ca10c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:01.860107 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-99382d47-6087-4122-80c1-f6a2c4ca10c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:01.868385 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-99382d47-6087-4122-80c1-f6a2c4ca10c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:01.869905 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-99382d47-6087-4122-80c1-f6a2c4ca10c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:01.871172 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-99382d47-6087-4122-80c1-f6a2c4ca10c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.157195 Aug 19 16:34:01.871741 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 184/371] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:01 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:02.675702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1ca0e9f1-7d92-4de8-b651-dc8600e1227f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:02.676439 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1ca0e9f1-7d92-4de8-b651-dc8600e1227f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:02.685020 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1ca0e9f1-7d92-4de8-b651-dc8600e1227f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:02.685658 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1ca0e9f1-7d92-4de8-b651-dc8600e1227f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:02.686206 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1ca0e9f1-7d92-4de8-b651-dc8600e1227f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:02.687828 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1ca0e9f1-7d92-4de8-b651-dc8600e1227f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:02.688773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1ca0e9f1-7d92-4de8-b651-dc8600e1227f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:02.689392 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1ca0e9f1-7d92-4de8-b651-dc8600e1227f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:02.848884 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1ca0e9f1-7d92-4de8-b651-dc8600e1227f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:02.857723 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1ca0e9f1-7d92-4de8-b651-dc8600e1227f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1509 microversion: 2.1 time: 0.185843 Aug 19 16:34:02.858410 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 188/372] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:02 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:02.894584 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6b493d04-77d8-4d4c-8c5f-68d032391675 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:02.895203 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6b493d04-77d8-4d4c-8c5f-68d032391675 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:02.901695 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6b493d04-77d8-4d4c-8c5f-68d032391675 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:02.902187 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6b493d04-77d8-4d4c-8c5f-68d032391675 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:02.902657 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6b493d04-77d8-4d4c-8c5f-68d032391675 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:02.903358 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6b493d04-77d8-4d4c-8c5f-68d032391675 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:02.903813 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6b493d04-77d8-4d4c-8c5f-68d032391675 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:02.904237 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6b493d04-77d8-4d4c-8c5f-68d032391675 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:03.124645 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6b493d04-77d8-4d4c-8c5f-68d032391675 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:03.133538 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6b493d04-77d8-4d4c-8c5f-68d032391675 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:03.135053 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6b493d04-77d8-4d4c-8c5f-68d032391675 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:03.136253 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6b493d04-77d8-4d4c-8c5f-68d032391675 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.246024 Aug 19 16:34:03.136871 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 185/373] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:02 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:03.883474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8b50e6ff-3238-4a44-bf16-45aff1735bab tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:03.885124 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8b50e6ff-3238-4a44-bf16-45aff1735bab tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:03.893638 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b50e6ff-3238-4a44-bf16-45aff1735bab tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:03.894122 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b50e6ff-3238-4a44-bf16-45aff1735bab tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:03.894562 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b50e6ff-3238-4a44-bf16-45aff1735bab tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:03.895250 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b50e6ff-3238-4a44-bf16-45aff1735bab tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:03.895696 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b50e6ff-3238-4a44-bf16-45aff1735bab tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:03.896313 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8b50e6ff-3238-4a44-bf16-45aff1735bab tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:04.041976 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8b50e6ff-3238-4a44-bf16-45aff1735bab tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:04.052623 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8b50e6ff-3238-4a44-bf16-45aff1735bab tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1509 microversion: 2.1 time: 0.175421 Aug 19 16:34:04.054241 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 189/374] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:03 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:04.160148 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-10b8b6cf-e0a6-4891-8702-e7c01507f7e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:04.160991 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-10b8b6cf-e0a6-4891-8702-e7c01507f7e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:04.168381 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-10b8b6cf-e0a6-4891-8702-e7c01507f7e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:04.168899 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-10b8b6cf-e0a6-4891-8702-e7c01507f7e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:04.169322 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-10b8b6cf-e0a6-4891-8702-e7c01507f7e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:04.170024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-10b8b6cf-e0a6-4891-8702-e7c01507f7e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:04.170648 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-10b8b6cf-e0a6-4891-8702-e7c01507f7e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:04.171072 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-10b8b6cf-e0a6-4891-8702-e7c01507f7e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:04.311166 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-10b8b6cf-e0a6-4891-8702-e7c01507f7e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:04.321997 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-10b8b6cf-e0a6-4891-8702-e7c01507f7e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:04.323579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-10b8b6cf-e0a6-4891-8702-e7c01507f7e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:04.324901 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-10b8b6cf-e0a6-4891-8702-e7c01507f7e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.169040 Aug 19 16:34:04.325461 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 186/375] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:04 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:05.075397 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-39ab15f7-dbe7-435f-815d-844548a51411 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:05.075978 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-39ab15f7-dbe7-435f-815d-844548a51411 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:05.082740 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39ab15f7-dbe7-435f-815d-844548a51411 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:05.083209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39ab15f7-dbe7-435f-815d-844548a51411 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:05.083817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39ab15f7-dbe7-435f-815d-844548a51411 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:05.084641 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39ab15f7-dbe7-435f-815d-844548a51411 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:05.085140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39ab15f7-dbe7-435f-815d-844548a51411 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:05.085560 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39ab15f7-dbe7-435f-815d-844548a51411 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:05.230990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-39ab15f7-dbe7-435f-815d-844548a51411 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:05.239045 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-39ab15f7-dbe7-435f-815d-844548a51411 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1509 microversion: 2.1 time: 0.167460 Aug 19 16:34:05.239770 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 190/376] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:05 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:05.349062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1e5a5608-bd3b-45d5-95fa-0905abc2abbd tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:05.350927 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-1e5a5608-bd3b-45d5-95fa-0905abc2abbd tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:05.357199 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1e5a5608-bd3b-45d5-95fa-0905abc2abbd tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:05.357803 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1e5a5608-bd3b-45d5-95fa-0905abc2abbd tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:05.358335 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1e5a5608-bd3b-45d5-95fa-0905abc2abbd tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:05.359096 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1e5a5608-bd3b-45d5-95fa-0905abc2abbd tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:05.359743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1e5a5608-bd3b-45d5-95fa-0905abc2abbd tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:05.360333 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1e5a5608-bd3b-45d5-95fa-0905abc2abbd tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:05.497874 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1e5a5608-bd3b-45d5-95fa-0905abc2abbd tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:05.507000 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1e5a5608-bd3b-45d5-95fa-0905abc2abbd tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:05.508528 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1e5a5608-bd3b-45d5-95fa-0905abc2abbd tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:05.509732 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-1e5a5608-bd3b-45d5-95fa-0905abc2abbd tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.164496 Aug 19 16:34:05.510281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 187/377] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:05 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:06.261269 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f953a3cc-ae1f-4fe7-abec-f5f4e3559271 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:06.261862 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f953a3cc-ae1f-4fe7-abec-f5f4e3559271 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:06.264257 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:34:06.270687 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f953a3cc-ae1f-4fe7-abec-f5f4e3559271 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:06.271294 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f953a3cc-ae1f-4fe7-abec-f5f4e3559271 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:06.271944 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f953a3cc-ae1f-4fe7-abec-f5f4e3559271 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:06.272727 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f953a3cc-ae1f-4fe7-abec-f5f4e3559271 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:06.273284 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f953a3cc-ae1f-4fe7-abec-f5f4e3559271 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:06.273830 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f953a3cc-ae1f-4fe7-abec-f5f4e3559271 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:06.432396 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f953a3cc-ae1f-4fe7-abec-f5f4e3559271 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:06.441556 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f953a3cc-ae1f-4fe7-abec-f5f4e3559271 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1509 microversion: 2.1 time: 0.184108 Aug 19 16:34:06.442121 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 191/378] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:06 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:06.533089 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-99d9cf52-29ec-4b92-b74a-f57d3e35837d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:06.533698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-99d9cf52-29ec-4b92-b74a-f57d3e35837d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:06.539973 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-99d9cf52-29ec-4b92-b74a-f57d3e35837d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:06.540443 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-99d9cf52-29ec-4b92-b74a-f57d3e35837d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:06.540897 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-99d9cf52-29ec-4b92-b74a-f57d3e35837d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:06.541590 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-99d9cf52-29ec-4b92-b74a-f57d3e35837d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:06.542202 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-99d9cf52-29ec-4b92-b74a-f57d3e35837d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:06.542633 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-99d9cf52-29ec-4b92-b74a-f57d3e35837d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:06.688312 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-99d9cf52-29ec-4b92-b74a-f57d3e35837d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:06.696728 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-99d9cf52-29ec-4b92-b74a-f57d3e35837d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:06.698336 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-99d9cf52-29ec-4b92-b74a-f57d3e35837d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:06.699479 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-99d9cf52-29ec-4b92-b74a-f57d3e35837d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.170363 Aug 19 16:34:06.700016 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 188/379] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:06 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:07.464692 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-213a4e35-fa47-486d-ae92-23e6bf5b6cd6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:07.465285 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-213a4e35-fa47-486d-ae92-23e6bf5b6cd6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:07.471200 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-213a4e35-fa47-486d-ae92-23e6bf5b6cd6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:07.471884 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-213a4e35-fa47-486d-ae92-23e6bf5b6cd6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:07.472318 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-213a4e35-fa47-486d-ae92-23e6bf5b6cd6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:07.473044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-213a4e35-fa47-486d-ae92-23e6bf5b6cd6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:07.473494 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-213a4e35-fa47-486d-ae92-23e6bf5b6cd6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:07.473915 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-213a4e35-fa47-486d-ae92-23e6bf5b6cd6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:07.612032 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-213a4e35-fa47-486d-ae92-23e6bf5b6cd6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:07.620861 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-213a4e35-fa47-486d-ae92-23e6bf5b6cd6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1509 microversion: 2.1 time: 0.161129 Aug 19 16:34:07.621469 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 192/380] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:07 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:07.722724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a608d597-a21a-4dfd-b9b3-228002b3d9fb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:07.724152 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a608d597-a21a-4dfd-b9b3-228002b3d9fb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:07.731084 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a608d597-a21a-4dfd-b9b3-228002b3d9fb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:07.731794 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a608d597-a21a-4dfd-b9b3-228002b3d9fb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:07.732418 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a608d597-a21a-4dfd-b9b3-228002b3d9fb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:07.733323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a608d597-a21a-4dfd-b9b3-228002b3d9fb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:07.734097 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a608d597-a21a-4dfd-b9b3-228002b3d9fb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:07.734717 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a608d597-a21a-4dfd-b9b3-228002b3d9fb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:07.888556 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a608d597-a21a-4dfd-b9b3-228002b3d9fb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:07.898020 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a608d597-a21a-4dfd-b9b3-228002b3d9fb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:07.899541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a608d597-a21a-4dfd-b9b3-228002b3d9fb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:07.900915 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a608d597-a21a-4dfd-b9b3-228002b3d9fb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.182190 Aug 19 16:34:07.901468 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 189/381] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:07 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:08.648906 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b30eaa90-c8a3-43fa-89f0-24381ad8e8cb tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:08.649553 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-b30eaa90-c8a3-43fa-89f0-24381ad8e8cb tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:08.662056 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b30eaa90-c8a3-43fa-89f0-24381ad8e8cb tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:08.662653 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b30eaa90-c8a3-43fa-89f0-24381ad8e8cb tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:08.663214 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b30eaa90-c8a3-43fa-89f0-24381ad8e8cb tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:08.663939 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b30eaa90-c8a3-43fa-89f0-24381ad8e8cb tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:08.664400 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b30eaa90-c8a3-43fa-89f0-24381ad8e8cb tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:08.664959 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b30eaa90-c8a3-43fa-89f0-24381ad8e8cb tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:08.928389 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-35963fa3-f099-4761-89ba-1a544d5b1561 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:08.929032 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-35963fa3-f099-4761-89ba-1a544d5b1561 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:08.930992 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=73 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:34:08.937624 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-35963fa3-f099-4761-89ba-1a544d5b1561 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:08.938111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-35963fa3-f099-4761-89ba-1a544d5b1561 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:08.938539 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-35963fa3-f099-4761-89ba-1a544d5b1561 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:08.939471 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-35963fa3-f099-4761-89ba-1a544d5b1561 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:08.939914 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-35963fa3-f099-4761-89ba-1a544d5b1561 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:08.940540 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-35963fa3-f099-4761-89ba-1a544d5b1561 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:09.043112 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b30eaa90-c8a3-43fa-89f0-24381ad8e8cb tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:09.065295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b30eaa90-c8a3-43fa-89f0-24381ad8e8cb tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1509 microversion: 2.1 time: 0.426929 Aug 19 16:34:09.066183 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 193/382] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:08 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1509 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:09.101656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-35963fa3-f099-4761-89ba-1a544d5b1561 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:09.109879 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-35963fa3-f099-4761-89ba-1a544d5b1561 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:09.111934 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-35963fa3-f099-4761-89ba-1a544d5b1561 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:09.113226 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-35963fa3-f099-4761-89ba-1a544d5b1561 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.190758 Aug 19 16:34:09.114000 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 190/383] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:08 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:10.087785 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a8c44676-f958-43fe-a23a-bf4221891da2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:10.088670 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a8c44676-f958-43fe-a23a-bf4221891da2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:10.095530 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a8c44676-f958-43fe-a23a-bf4221891da2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:10.095937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a8c44676-f958-43fe-a23a-bf4221891da2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:10.096505 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a8c44676-f958-43fe-a23a-bf4221891da2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:10.097237 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a8c44676-f958-43fe-a23a-bf4221891da2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:10.097694 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a8c44676-f958-43fe-a23a-bf4221891da2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:10.098219 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a8c44676-f958-43fe-a23a-bf4221891da2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:10.141965 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-5444aee6-76c2-4087-a13a-066b6e703681 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:10.148159 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-5444aee6-76c2-4087-a13a-066b6e703681 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:10.157285 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5444aee6-76c2-4087-a13a-066b6e703681 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:10.158333 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5444aee6-76c2-4087-a13a-066b6e703681 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:10.159310 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5444aee6-76c2-4087-a13a-066b6e703681 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:10.160219 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5444aee6-76c2-4087-a13a-066b6e703681 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:10.161114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5444aee6-76c2-4087-a13a-066b6e703681 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:10.163259 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5444aee6-76c2-4087-a13a-066b6e703681 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:10.262536 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a8c44676-f958-43fe-a23a-bf4221891da2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:10.271686 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a8c44676-f958-43fe-a23a-bf4221891da2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1509 microversion: 2.1 time: 0.187837 Aug 19 16:34:10.272535 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 194/384] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:10 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:10.314676 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5444aee6-76c2-4087-a13a-066b6e703681 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:10.325989 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5444aee6-76c2-4087-a13a-066b6e703681 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:10.328085 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5444aee6-76c2-4087-a13a-066b6e703681 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:10.329701 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-5444aee6-76c2-4087-a13a-066b6e703681 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.192350 Aug 19 16:34:10.330644 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 191/385] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:10 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:34:11.293271 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-531f7ade-420e-4bcd-a35c-c58d1f4663d4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:11.294051 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-531f7ade-420e-4bcd-a35c-c58d1f4663d4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:11.300683 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-531f7ade-420e-4bcd-a35c-c58d1f4663d4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:11.301191 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-531f7ade-420e-4bcd-a35c-c58d1f4663d4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:11.301626 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-531f7ade-420e-4bcd-a35c-c58d1f4663d4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:11.302340 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-531f7ade-420e-4bcd-a35c-c58d1f4663d4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:11.302908 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-531f7ade-420e-4bcd-a35c-c58d1f4663d4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:11.303469 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-531f7ade-420e-4bcd-a35c-c58d1f4663d4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:11.356630 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ba60874a-3b4a-4e76-b048-8e7fb4dc42a1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:11.357598 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ba60874a-3b4a-4e76-b048-8e7fb4dc42a1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:11.372010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ba60874a-3b4a-4e76-b048-8e7fb4dc42a1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:11.372497 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ba60874a-3b4a-4e76-b048-8e7fb4dc42a1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:11.373089 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ba60874a-3b4a-4e76-b048-8e7fb4dc42a1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:11.374224 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ba60874a-3b4a-4e76-b048-8e7fb4dc42a1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:11.374692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ba60874a-3b4a-4e76-b048-8e7fb4dc42a1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:11.375201 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ba60874a-3b4a-4e76-b048-8e7fb4dc42a1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:11.478871 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-531f7ade-420e-4bcd-a35c-c58d1f4663d4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:11.487097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-531f7ade-420e-4bcd-a35c-c58d1f4663d4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1509 microversion: 2.1 time: 0.197691 Aug 19 16:34:11.487869 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 195/386] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:11 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:11.540972 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ba60874a-3b4a-4e76-b048-8e7fb4dc42a1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:11.549803 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ba60874a-3b4a-4e76-b048-8e7fb4dc42a1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:11.551547 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ba60874a-3b4a-4e76-b048-8e7fb4dc42a1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:11.553421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ba60874a-3b4a-4e76-b048-8e7fb4dc42a1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.203862 Aug 19 16:34:11.554144 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 192/387] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:11 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:12.509852 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-46bdc5ff-7ff2-459b-b77d-0ba78794ab80 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:12.510597 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-46bdc5ff-7ff2-459b-b77d-0ba78794ab80 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:12.517120 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-46bdc5ff-7ff2-459b-b77d-0ba78794ab80 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:12.517856 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-46bdc5ff-7ff2-459b-b77d-0ba78794ab80 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:12.518380 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-46bdc5ff-7ff2-459b-b77d-0ba78794ab80 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:12.519146 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-46bdc5ff-7ff2-459b-b77d-0ba78794ab80 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:12.519613 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-46bdc5ff-7ff2-459b-b77d-0ba78794ab80 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:12.520032 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-46bdc5ff-7ff2-459b-b77d-0ba78794ab80 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:12.581874 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e11a452e-f459-4b05-8154-76f074c2e053 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:12.582601 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e11a452e-f459-4b05-8154-76f074c2e053 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:12.600274 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e11a452e-f459-4b05-8154-76f074c2e053 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:12.600793 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e11a452e-f459-4b05-8154-76f074c2e053 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:12.601228 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e11a452e-f459-4b05-8154-76f074c2e053 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:12.601937 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e11a452e-f459-4b05-8154-76f074c2e053 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:12.602375 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e11a452e-f459-4b05-8154-76f074c2e053 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:12.602796 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e11a452e-f459-4b05-8154-76f074c2e053 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:12.726273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-46bdc5ff-7ff2-459b-b77d-0ba78794ab80 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:12.747361 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-46bdc5ff-7ff2-459b-b77d-0ba78794ab80 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1509 microversion: 2.1 time: 0.241913 Aug 19 16:34:12.753937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 196/388] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:12 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1509 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:12.782144 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e11a452e-f459-4b05-8154-76f074c2e053 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:12.793387 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e11a452e-f459-4b05-8154-76f074c2e053 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:12.795110 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e11a452e-f459-4b05-8154-76f074c2e053 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:12.797102 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e11a452e-f459-4b05-8154-76f074c2e053 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.223887 Aug 19 16:34:12.801740 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 193/389] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:12 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:13.776068 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-25d6fda2-937e-4982-923c-c64f2a0f3388 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:13.776696 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-25d6fda2-937e-4982-923c-c64f2a0f3388 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:13.783986 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-25d6fda2-937e-4982-923c-c64f2a0f3388 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:13.784471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-25d6fda2-937e-4982-923c-c64f2a0f3388 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:13.784944 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-25d6fda2-937e-4982-923c-c64f2a0f3388 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:13.785708 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-25d6fda2-937e-4982-923c-c64f2a0f3388 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:13.786319 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-25d6fda2-937e-4982-923c-c64f2a0f3388 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:13.786765 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-25d6fda2-937e-4982-923c-c64f2a0f3388 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:13.820212 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-08ca0b41-ad9c-4548-9c44-8334e6b5e491 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:13.821489 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-08ca0b41-ad9c-4548-9c44-8334e6b5e491 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:13.831802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-08ca0b41-ad9c-4548-9c44-8334e6b5e491 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:13.832570 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-08ca0b41-ad9c-4548-9c44-8334e6b5e491 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:13.833220 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-08ca0b41-ad9c-4548-9c44-8334e6b5e491 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:13.834121 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-08ca0b41-ad9c-4548-9c44-8334e6b5e491 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:13.834773 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-08ca0b41-ad9c-4548-9c44-8334e6b5e491 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:13.835498 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-08ca0b41-ad9c-4548-9c44-8334e6b5e491 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:13.978023 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-25d6fda2-937e-4982-923c-c64f2a0f3388 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:13.987424 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-25d6fda2-937e-4982-923c-c64f2a0f3388 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1515 microversion: 2.1 time: 0.215897 Aug 19 16:34:13.989893 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 197/390] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:13 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1515 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:14.035009 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-08ca0b41-ad9c-4548-9c44-8334e6b5e491 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:14.044443 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-08ca0b41-ad9c-4548-9c44-8334e6b5e491 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:14.045962 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-08ca0b41-ad9c-4548-9c44-8334e6b5e491 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:14.047309 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-08ca0b41-ad9c-4548-9c44-8334e6b5e491 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.231700 Aug 19 16:34:14.048790 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 194/391] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:13 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:14.929344 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-6b20386c-f673-4d39-9d10-18fb770d4e56 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:14.929847 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-6b20386c-f673-4d39-9d10-18fb770d4e56 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:14.936054 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6b20386c-f673-4d39-9d10-18fb770d4e56 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:14.936525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6b20386c-f673-4d39-9d10-18fb770d4e56 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:14.936998 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6b20386c-f673-4d39-9d10-18fb770d4e56 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:14.937676 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6b20386c-f673-4d39-9d10-18fb770d4e56 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:14.938118 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6b20386c-f673-4d39-9d10-18fb770d4e56 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:14.938531 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6b20386c-f673-4d39-9d10-18fb770d4e56 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:14.962676 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-6b20386c-f673-4d39-9d10-18fb770d4e56 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/ips" status: 200 len: 149 microversion: 2.1 time: 0.037421 Aug 19 16:34:14.963227 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 198/392] 10.222.0.55 () {58 vars in 1248 bytes} [Fri Aug 19 16:34:14 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:34:15.075843 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ed9ae9a0-bf07-4126-a31a-71a301bc566c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:15.077319 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ed9ae9a0-bf07-4126-a31a-71a301bc566c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:15.084296 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ed9ae9a0-bf07-4126-a31a-71a301bc566c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:15.084885 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ed9ae9a0-bf07-4126-a31a-71a301bc566c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:15.085318 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ed9ae9a0-bf07-4126-a31a-71a301bc566c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:15.086177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ed9ae9a0-bf07-4126-a31a-71a301bc566c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:15.086636 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ed9ae9a0-bf07-4126-a31a-71a301bc566c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:15.087184 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ed9ae9a0-bf07-4126-a31a-71a301bc566c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:15.242417 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ed9ae9a0-bf07-4126-a31a-71a301bc566c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:15.252119 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ed9ae9a0-bf07-4126-a31a-71a301bc566c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:15.253654 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ed9ae9a0-bf07-4126-a31a-71a301bc566c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:15.254972 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ed9ae9a0-bf07-4126-a31a-71a301bc566c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.183436 Aug 19 16:34:15.256339 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 195/393] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:15 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:15.419106 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e3c0e29b-d3e5-46dc-a803-e6030f89adcc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Action: 'create', calling method: .version_select at 0x7fb01e2aba60>, body: {"keypair": {"name": "tempest-keypair-229491225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEhu7vYT/zR2J7+Bng2kYg57J2cRxv56SLuBNV/NMYQdteVk9bkYyWUaalK11GHADwZorHvsP4SijJl/Am0qr9+5dakGxH0ZxlzHPjYjslNg+Bz32FAXr7O9ikB7fxAkg=="}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:34:15.436291 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-e3c0e29b-d3e5-46dc-a803-e6030f89adcc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Getting quotas for project b5638f78ab9440479a209d0023e6d0bd. Resources: {'key_pairs'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:34:15.440466 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-e3c0e29b-d3e5-46dc-a803-e6030f89adcc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Getting quotas for user 7936bf23a031418b8ce304aa3bbcf8a2 and project b5638f78ab9440479a209d0023e6d0bd. Resources: {'key_pairs'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:34:15.463666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e3c0e29b-d3e5-46dc-a803-e6030f89adcc tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048434 Aug 19 16:34:15.464282 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 199/394] 10.222.0.55 () {60 vars in 1159 bytes} [Fri Aug 19 16:34:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:34:16.282674 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-5592a557-3263-49f3-8cae-97b9a0417e23 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:16.283288 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-5592a557-3263-49f3-8cae-97b9a0417e23 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:16.290618 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5592a557-3263-49f3-8cae-97b9a0417e23 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:16.291099 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5592a557-3263-49f3-8cae-97b9a0417e23 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:16.291571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5592a557-3263-49f3-8cae-97b9a0417e23 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:16.292268 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5592a557-3263-49f3-8cae-97b9a0417e23 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:16.292827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5592a557-3263-49f3-8cae-97b9a0417e23 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:16.301346 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5592a557-3263-49f3-8cae-97b9a0417e23 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:16.367671 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-24771d5a-ac4f-4528-8fbe-bb1f30307a98 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a191975-dc72-49fd-b26d-3e605ddb5a23"}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:34:16.370938 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-24771d5a-ac4f-4528-8fbe-bb1f30307a98 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:16.377817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-24771d5a-ac4f-4528-8fbe-bb1f30307a98 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:16.378508 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-24771d5a-ac4f-4528-8fbe-bb1f30307a98 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:16.378939 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-24771d5a-ac4f-4528-8fbe-bb1f30307a98 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:16.379629 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-24771d5a-ac4f-4528-8fbe-bb1f30307a98 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:16.380076 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-24771d5a-ac4f-4528-8fbe-bb1f30307a98 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:16.381040 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-24771d5a-ac4f-4528-8fbe-bb1f30307a98 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:16.769583 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-24771d5a-ac4f-4528-8fbe-bb1f30307a98 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "POST /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406783 Aug 19 16:34:16.770116 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 200/395] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Aug 19 16:34:16 2022] POST /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:34:16.774178 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5592a557-3263-49f3-8cae-97b9a0417e23 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:16.798475 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5592a557-3263-49f3-8cae-97b9a0417e23 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:16.804681 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5592a557-3263-49f3-8cae-97b9a0417e23 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:16.806082 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-5592a557-3263-49f3-8cae-97b9a0417e23 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.527308 Aug 19 16:34:16.806714 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 196/396] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:16 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:17.043180 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1d71a14c-895c-41f6-a52e-97dcbf630b02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-167118331", "imageRef": "da4af7b7-e205-4511-ad99-3478c2523f74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6f514de-28c6-4283-b943-c70fcda5540b"}], "security_groups": [{"name": "tempest-securitygroup--2090408069"}], "key_name": "tempest-keypair-229491225", "user_data": "}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:34:17.830147 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1e7b0019-2a93-4fab-8b9a-d2137feffe58 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:17.831878 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-1e7b0019-2a93-4fab-8b9a-d2137feffe58 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:17.839393 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1e7b0019-2a93-4fab-8b9a-d2137feffe58 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:17.839882 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1e7b0019-2a93-4fab-8b9a-d2137feffe58 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:17.840314 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1e7b0019-2a93-4fab-8b9a-d2137feffe58 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:17.841038 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1e7b0019-2a93-4fab-8b9a-d2137feffe58 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:17.841671 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1e7b0019-2a93-4fab-8b9a-d2137feffe58 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:17.841973 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1e7b0019-2a93-4fab-8b9a-d2137feffe58 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:17.974886 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1e7b0019-2a93-4fab-8b9a-d2137feffe58 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:17.982933 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1e7b0019-2a93-4fab-8b9a-d2137feffe58 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:17.984424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1e7b0019-2a93-4fab-8b9a-d2137feffe58 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:17.985626 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-1e7b0019-2a93-4fab-8b9a-d2137feffe58 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.160137 Aug 19 16:34:17.986184 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 197/397] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:17 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:34:19.009354 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-144351e1-cc87-41ec-8f6e-432a176753e5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:19.010430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-144351e1-cc87-41ec-8f6e-432a176753e5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:19.018554 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-144351e1-cc87-41ec-8f6e-432a176753e5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:19.019390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-144351e1-cc87-41ec-8f6e-432a176753e5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:19.020163 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-144351e1-cc87-41ec-8f6e-432a176753e5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:19.021894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-144351e1-cc87-41ec-8f6e-432a176753e5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:19.022599 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-144351e1-cc87-41ec-8f6e-432a176753e5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:19.023229 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-144351e1-cc87-41ec-8f6e-432a176753e5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:19.239164 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-144351e1-cc87-41ec-8f6e-432a176753e5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:19.265883 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-144351e1-cc87-41ec-8f6e-432a176753e5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:19.267502 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-144351e1-cc87-41ec-8f6e-432a176753e5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:19.269059 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-144351e1-cc87-41ec-8f6e-432a176753e5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.264278 Aug 19 16:34:19.269800 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 198/398] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:19 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:34:20.291900 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-97c5795d-c208-445d-af7e-7785954a1988 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:20.292579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-97c5795d-c208-445d-af7e-7785954a1988 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:20.298651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-97c5795d-c208-445d-af7e-7785954a1988 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:20.299151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-97c5795d-c208-445d-af7e-7785954a1988 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:20.299567 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-97c5795d-c208-445d-af7e-7785954a1988 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:20.300445 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-97c5795d-c208-445d-af7e-7785954a1988 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:20.300944 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-97c5795d-c208-445d-af7e-7785954a1988 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:20.301369 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-97c5795d-c208-445d-af7e-7785954a1988 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:20.305712 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=100 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:34:20.433744 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-97c5795d-c208-445d-af7e-7785954a1988 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:20.441938 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-97c5795d-c208-445d-af7e-7785954a1988 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:20.443990 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-97c5795d-c208-445d-af7e-7785954a1988 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:20.445149 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-97c5795d-c208-445d-af7e-7785954a1988 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.157213 Aug 19 16:34:20.445692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 199/399] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:20 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:21.471039 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-bbf0daba-bc7a-48ef-a81b-1d21252e0687 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:21.471654 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-bbf0daba-bc7a-48ef-a81b-1d21252e0687 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:21.478007 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bbf0daba-bc7a-48ef-a81b-1d21252e0687 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:21.478743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bbf0daba-bc7a-48ef-a81b-1d21252e0687 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:21.479184 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bbf0daba-bc7a-48ef-a81b-1d21252e0687 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:21.479873 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bbf0daba-bc7a-48ef-a81b-1d21252e0687 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:21.480320 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bbf0daba-bc7a-48ef-a81b-1d21252e0687 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:21.480964 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bbf0daba-bc7a-48ef-a81b-1d21252e0687 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:21.617045 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-bbf0daba-bc7a-48ef-a81b-1d21252e0687 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:21.625257 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-bbf0daba-bc7a-48ef-a81b-1d21252e0687 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:21.626887 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-bbf0daba-bc7a-48ef-a81b-1d21252e0687 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:21.628109 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-bbf0daba-bc7a-48ef-a81b-1d21252e0687 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.160949 Aug 19 16:34:21.628648 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 200/400] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:21 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:34:22.652366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-05a16d2d-c178-498e-bbfc-7e1379134866 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:22.653831 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-05a16d2d-c178-498e-bbfc-7e1379134866 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:22.660457 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-05a16d2d-c178-498e-bbfc-7e1379134866 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:22.661156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-05a16d2d-c178-498e-bbfc-7e1379134866 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:22.662812 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-05a16d2d-c178-498e-bbfc-7e1379134866 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:22.663935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-05a16d2d-c178-498e-bbfc-7e1379134866 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:22.664609 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-05a16d2d-c178-498e-bbfc-7e1379134866 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:22.665116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-05a16d2d-c178-498e-bbfc-7e1379134866 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:22.815160 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-05a16d2d-c178-498e-bbfc-7e1379134866 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:22.826105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-05a16d2d-c178-498e-bbfc-7e1379134866 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:22.827704 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-05a16d2d-c178-498e-bbfc-7e1379134866 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:22.830407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-05a16d2d-c178-498e-bbfc-7e1379134866 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.183209 Aug 19 16:34:22.831841 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 201/401] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:22 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:34:23.855402 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2d7503eb-e022-4435-888e-6084faf77bab tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:23.856558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2d7503eb-e022-4435-888e-6084faf77bab tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:23.862933 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2d7503eb-e022-4435-888e-6084faf77bab tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:23.863417 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2d7503eb-e022-4435-888e-6084faf77bab tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:23.863852 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2d7503eb-e022-4435-888e-6084faf77bab tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:23.864542 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2d7503eb-e022-4435-888e-6084faf77bab tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:23.865021 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2d7503eb-e022-4435-888e-6084faf77bab tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:23.866024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2d7503eb-e022-4435-888e-6084faf77bab tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:24.009411 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2d7503eb-e022-4435-888e-6084faf77bab tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:24.017529 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2d7503eb-e022-4435-888e-6084faf77bab tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:24.019043 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2d7503eb-e022-4435-888e-6084faf77bab tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:24.020181 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2d7503eb-e022-4435-888e-6084faf77bab tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.169009 Aug 19 16:34:24.032920 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 202/402] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:23 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:34:24.465654 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.network.neutron [None req-1d71a14c-895c-41f6-a52e-97dcbf630b02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] validate_networks() for [('b6f514de-28c6-4283-b943-c70fcda5540b', None, None, None, None, None)] {{(pid=127284) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:34:24.878598 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-1d71a14c-895c-41f6-a52e-97dcbf630b02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Flavor limits 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:34:24.879279 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-1d71a14c-895c-41f6-a52e-97dcbf630b02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Image limits 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:34:24.880516 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-1d71a14c-895c-41f6-a52e-97dcbf630b02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Flavor pref 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:34:24.881128 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-1d71a14c-895c-41f6-a52e-97dcbf630b02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Image pref 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:34:24.881641 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-1d71a14c-895c-41f6-a52e-97dcbf630b02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:34:24.895658 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1d71a14c-895c-41f6-a52e-97dcbf630b02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:24.896209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1d71a14c-895c-41f6-a52e-97dcbf630b02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:24.897129 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1d71a14c-895c-41f6-a52e-97dcbf630b02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:24.898079 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1d71a14c-895c-41f6-a52e-97dcbf630b02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:24.899350 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1d71a14c-895c-41f6-a52e-97dcbf630b02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:24.899981 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1d71a14c-895c-41f6-a52e-97dcbf630b02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:24.920868 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-1d71a14c-895c-41f6-a52e-97dcbf630b02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Getting quotas for project b5638f78ab9440479a209d0023e6d0bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:34:24.925471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-1d71a14c-895c-41f6-a52e-97dcbf630b02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Getting quotas for user 7936bf23a031418b8ce304aa3bbcf8a2 and project b5638f78ab9440479a209d0023e6d0bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:34:24.939575 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1d71a14c-895c-41f6-a52e-97dcbf630b02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Going to run 1 instances... {{(pid=127284) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:34:24.942038 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1d71a14c-895c-41f6-a52e-97dcbf630b02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='da4af7b7-e205-4511-ad99-3478c2523f74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:34:25.003117 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1d71a14c-895c-41f6-a52e-97dcbf630b02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 7.965058 Aug 19 16:34:25.004497 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 201/403] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Aug 19 16:34:17 2022] POST /compute/v2.1/servers => generated 409 bytes in 7968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 16:34:25.017909 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-23207823-eec8-4ab1-b2bb-bb0616a85554 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:25.019297 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-23207823-eec8-4ab1-b2bb-bb0616a85554 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:25.043495 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d2080060-428f-48a0-ba47-6ea2da1c1250 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:25.044100 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d2080060-428f-48a0-ba47-6ea2da1c1250 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:25.050848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d2080060-428f-48a0-ba47-6ea2da1c1250 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:25.051310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d2080060-428f-48a0-ba47-6ea2da1c1250 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:25.051743 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d2080060-428f-48a0-ba47-6ea2da1c1250 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:25.052432 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d2080060-428f-48a0-ba47-6ea2da1c1250 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:25.053443 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d2080060-428f-48a0-ba47-6ea2da1c1250 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:25.053867 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d2080060-428f-48a0-ba47-6ea2da1c1250 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:25.072621 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:34:25.104535 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-23207823-eec8-4ab1-b2bb-bb0616a85554 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:25.122904 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-23207823-eec8-4ab1-b2bb-bb0616a85554 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1244 microversion: 2.1 time: 0.110605 Aug 19 16:34:25.123979 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 203/404] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:25 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1244 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:25.218865 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d2080060-428f-48a0-ba47-6ea2da1c1250 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:25.227386 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d2080060-428f-48a0-ba47-6ea2da1c1250 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:25.228920 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d2080060-428f-48a0-ba47-6ea2da1c1250 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:25.230070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d2080060-428f-48a0-ba47-6ea2da1c1250 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.190537 Aug 19 16:34:25.230629 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 202/405] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:25 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:34:26.147637 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-51d635ad-fc34-41b1-a47b-494a813d35c2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:26.148451 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-51d635ad-fc34-41b1-a47b-494a813d35c2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:26.154574 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-51d635ad-fc34-41b1-a47b-494a813d35c2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:26.155063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-51d635ad-fc34-41b1-a47b-494a813d35c2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:26.155495 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-51d635ad-fc34-41b1-a47b-494a813d35c2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:26.156392 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-51d635ad-fc34-41b1-a47b-494a813d35c2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:26.157481 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-51d635ad-fc34-41b1-a47b-494a813d35c2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:26.157921 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-51d635ad-fc34-41b1-a47b-494a813d35c2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:26.223236 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-51d635ad-fc34-41b1-a47b-494a813d35c2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:26.231173 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-51d635ad-fc34-41b1-a47b-494a813d35c2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1248 microversion: 2.1 time: 0.088218 Aug 19 16:34:26.231915 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 204/406] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:26 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1248 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:26.252603 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-28a774e0-8c73-4404-989c-6f99e7117288 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:26.253247 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-28a774e0-8c73-4404-989c-6f99e7117288 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:26.260453 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-28a774e0-8c73-4404-989c-6f99e7117288 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:26.260837 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-28a774e0-8c73-4404-989c-6f99e7117288 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:26.261269 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-28a774e0-8c73-4404-989c-6f99e7117288 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:26.261950 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-28a774e0-8c73-4404-989c-6f99e7117288 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:26.262396 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-28a774e0-8c73-4404-989c-6f99e7117288 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:26.262812 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-28a774e0-8c73-4404-989c-6f99e7117288 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:26.409155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-28a774e0-8c73-4404-989c-6f99e7117288 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:26.420387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-28a774e0-8c73-4404-989c-6f99e7117288 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:26.422109 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-28a774e0-8c73-4404-989c-6f99e7117288 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:26.423190 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-28a774e0-8c73-4404-989c-6f99e7117288 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.174496 Aug 19 16:34:26.423734 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 203/407] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:26 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:27.253036 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3679ace9-16d1-4c1d-8714-7d9119d195d9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:27.253792 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-3679ace9-16d1-4c1d-8714-7d9119d195d9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:27.261105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3679ace9-16d1-4c1d-8714-7d9119d195d9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:27.261602 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3679ace9-16d1-4c1d-8714-7d9119d195d9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:27.262030 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3679ace9-16d1-4c1d-8714-7d9119d195d9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:27.262742 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3679ace9-16d1-4c1d-8714-7d9119d195d9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:27.263203 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3679ace9-16d1-4c1d-8714-7d9119d195d9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:27.263627 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3679ace9-16d1-4c1d-8714-7d9119d195d9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:27.328948 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-3679ace9-16d1-4c1d-8714-7d9119d195d9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:27.338731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3679ace9-16d1-4c1d-8714-7d9119d195d9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1296 microversion: 2.1 time: 0.089498 Aug 19 16:34:27.339542 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 205/408] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:27 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1296 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:27.449401 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-102d6916-2a0f-45c1-8e89-06391455be01 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:27.450148 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-102d6916-2a0f-45c1-8e89-06391455be01 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:27.459261 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-102d6916-2a0f-45c1-8e89-06391455be01 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:27.459746 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-102d6916-2a0f-45c1-8e89-06391455be01 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:27.460171 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-102d6916-2a0f-45c1-8e89-06391455be01 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:27.461467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-102d6916-2a0f-45c1-8e89-06391455be01 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:27.461913 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-102d6916-2a0f-45c1-8e89-06391455be01 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:27.462336 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-102d6916-2a0f-45c1-8e89-06391455be01 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:27.617597 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-202619c6-cc50-476e-8ac8-4883695d7760 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Action: 'create', calling method: .version_select at 0x7fb01e336dc0>, body: {"keypair": {"name": "tempest-keypair-1146901198", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANlq/NCExGgoxutHnwbxfqtAsujTMhrZ5OnQ0Bnw/jvGNhcyjHUJ1yivXI/lrzM1BCGltoEeBGHNTSQAnutBw38LNliLHFCuP0QmWPXkndKxCc+I/ISnNdHyTJ72v2WuA=="}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:34:27.656080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-202619c6-cc50-476e-8ac8-4883695d7760 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Getting quotas for project 1743538991c8415394ac6cd5aed28d6a. Resources: {'key_pairs'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:34:27.662407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-202619c6-cc50-476e-8ac8-4883695d7760 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Getting quotas for user 9b0455ae3ec94c929c940df6a0f6687d and project 1743538991c8415394ac6cd5aed28d6a. Resources: {'key_pairs'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:34:27.722743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-202619c6-cc50-476e-8ac8-4883695d7760 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110467 Aug 19 16:34:27.724795 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 206/409] 10.222.0.55 () {60 vars in 1159 bytes} [Fri Aug 19 16:34:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:34:27.768696 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-102d6916-2a0f-45c1-8e89-06391455be01 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:27.779770 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-102d6916-2a0f-45c1-8e89-06391455be01 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:27.782430 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-102d6916-2a0f-45c1-8e89-06391455be01 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:27.783875 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-102d6916-2a0f-45c1-8e89-06391455be01 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.341459 Aug 19 16:34:27.804492 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 204/410] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:27 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:28.362199 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c2b696d7-e97a-4923-805f-af16a14250ff tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:28.363570 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c2b696d7-e97a-4923-805f-af16a14250ff tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:28.372046 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2b696d7-e97a-4923-805f-af16a14250ff tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:28.372920 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2b696d7-e97a-4923-805f-af16a14250ff tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:28.373599 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2b696d7-e97a-4923-805f-af16a14250ff tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:28.374778 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2b696d7-e97a-4923-805f-af16a14250ff tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:28.375561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2b696d7-e97a-4923-805f-af16a14250ff tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:28.376219 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2b696d7-e97a-4923-805f-af16a14250ff tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:28.510917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c2b696d7-e97a-4923-805f-af16a14250ff tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:28.530662 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c2b696d7-e97a-4923-805f-af16a14250ff tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1302 microversion: 2.1 time: 0.173000 Aug 19 16:34:28.531310 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 207/411] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:28 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1302 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:28.818744 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-18b6d056-4505-45dd-b010-90bf32db33a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:28.819672 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-18b6d056-4505-45dd-b010-90bf32db33a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:28.838621 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-18b6d056-4505-45dd-b010-90bf32db33a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:28.839409 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-18b6d056-4505-45dd-b010-90bf32db33a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:28.840073 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-18b6d056-4505-45dd-b010-90bf32db33a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:28.841030 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-18b6d056-4505-45dd-b010-90bf32db33a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:28.841697 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-18b6d056-4505-45dd-b010-90bf32db33a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:28.842326 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-18b6d056-4505-45dd-b010-90bf32db33a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:29.423541 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-18b6d056-4505-45dd-b010-90bf32db33a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:29.440839 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-18b6d056-4505-45dd-b010-90bf32db33a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:29.445462 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-18b6d056-4505-45dd-b010-90bf32db33a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:29.455957 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-18b6d056-4505-45dd-b010-90bf32db33a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.641370 Aug 19 16:34:29.456791 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 205/412] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:28 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:29.552452 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8a8a8510-0e6a-400c-8065-fab97c58cf64 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:29.553220 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8a8a8510-0e6a-400c-8065-fab97c58cf64 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:29.566499 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8a8a8510-0e6a-400c-8065-fab97c58cf64 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:29.568234 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8a8a8510-0e6a-400c-8065-fab97c58cf64 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:29.570928 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8a8a8510-0e6a-400c-8065-fab97c58cf64 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:29.572048 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8a8a8510-0e6a-400c-8065-fab97c58cf64 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:29.575762 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8a8a8510-0e6a-400c-8065-fab97c58cf64 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:29.576452 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8a8a8510-0e6a-400c-8065-fab97c58cf64 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:29.752521 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-23be27ae-a840-416b-a469-e70ba5781416 req-33d99a2f-6ef7-4c17-82ad-9a37a478d84d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ed4c246-7322-49b8-9bf7-2efaacc54b0b", "tag": "fe37ffff-6942-4410-8583-71fc27f97e1b"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:34:29.767042 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-23be27ae-a840-416b-a469-e70ba5781416 req-33d99a2f-6ef7-4c17-82ad-9a37a478d84d service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:29.774265 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-23be27ae-a840-416b-a469-e70ba5781416 req-33d99a2f-6ef7-4c17-82ad-9a37a478d84d service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:29.776355 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-23be27ae-a840-416b-a469-e70ba5781416 req-33d99a2f-6ef7-4c17-82ad-9a37a478d84d service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:29.809065 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-23be27ae-a840-416b-a469-e70ba5781416 req-33d99a2f-6ef7-4c17-82ad-9a37a478d84d service nova] Creating event network-changed:fe37ffff-6942-4410-8583-71fc27f97e1b for instance 9ed4c246-7322-49b8-9bf7-2efaacc54b0b on hv-cinder-83124 Aug 19 16:34:29.825396 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-23be27ae-a840-416b-a469-e70ba5781416 req-33d99a2f-6ef7-4c17-82ad-9a37a478d84d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072587 Aug 19 16:34:29.832928 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 206/413] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:34:29.856710 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-8a8a8510-0e6a-400c-8065-fab97c58cf64 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:29.874627 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8a8a8510-0e6a-400c-8065-fab97c58cf64 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1370 microversion: 2.1 time: 0.326299 Aug 19 16:34:29.888532 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 208/414] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:29 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1370 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:30.137179 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ac83981f-6df7-4575-acc2-d6cf1c818e10 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-40034143", "imageRef": "da4af7b7-e205-4511-ad99-3478c2523f74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f05c65e5-ca4c-4b49-b86f-b320d0d9f99a"}], "security_groups": [{"name": "tempest-securitygroup--32717613"}], "key_name": "tempest-keypair-1146901198", "user_data": "}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:34:30.299973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.network.neutron [None req-ac83981f-6df7-4575-acc2-d6cf1c818e10 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] validate_networks() for [('f05c65e5-ca4c-4b49-b86f-b320d0d9f99a', None, None, None, None, None)] {{(pid=127284) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:34:30.484325 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2ea7d16d-65b3-4c3a-b1a8-6e1bbc129a27 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:30.485456 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2ea7d16d-65b3-4c3a-b1a8-6e1bbc129a27 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:30.506205 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ea7d16d-65b3-4c3a-b1a8-6e1bbc129a27 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:30.506636 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ea7d16d-65b3-4c3a-b1a8-6e1bbc129a27 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:30.507103 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ea7d16d-65b3-4c3a-b1a8-6e1bbc129a27 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:30.507995 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ea7d16d-65b3-4c3a-b1a8-6e1bbc129a27 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:30.508453 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ea7d16d-65b3-4c3a-b1a8-6e1bbc129a27 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:30.508903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ea7d16d-65b3-4c3a-b1a8-6e1bbc129a27 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:30.808476 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2ea7d16d-65b3-4c3a-b1a8-6e1bbc129a27 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:30.817382 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2ea7d16d-65b3-4c3a-b1a8-6e1bbc129a27 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:30.823100 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2ea7d16d-65b3-4c3a-b1a8-6e1bbc129a27 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:30.828716 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2ea7d16d-65b3-4c3a-b1a8-6e1bbc129a27 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.350292 Aug 19 16:34:30.835916 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 209/415] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:30 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:34:30.895071 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-ac83981f-6df7-4575-acc2-d6cf1c818e10 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Flavor limits 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:34:30.896117 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-fda403a7-f48d-4f35-ad26-3c9ff47abe31 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:30.896266 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-ac83981f-6df7-4575-acc2-d6cf1c818e10 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Image limits 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:34:30.896729 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-fda403a7-f48d-4f35-ad26-3c9ff47abe31 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:30.897071 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-ac83981f-6df7-4575-acc2-d6cf1c818e10 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Flavor pref 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:34:30.897697 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-ac83981f-6df7-4575-acc2-d6cf1c818e10 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Image pref 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:34:30.899009 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-ac83981f-6df7-4575-acc2-d6cf1c818e10 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:34:30.904868 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fda403a7-f48d-4f35-ad26-3c9ff47abe31 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:30.905644 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fda403a7-f48d-4f35-ad26-3c9ff47abe31 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:30.906256 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fda403a7-f48d-4f35-ad26-3c9ff47abe31 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:30.907202 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fda403a7-f48d-4f35-ad26-3c9ff47abe31 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:30.907862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fda403a7-f48d-4f35-ad26-3c9ff47abe31 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:30.908435 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fda403a7-f48d-4f35-ad26-3c9ff47abe31 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:30.913850 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ac83981f-6df7-4575-acc2-d6cf1c818e10 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:30.914492 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ac83981f-6df7-4575-acc2-d6cf1c818e10 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:30.914944 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ac83981f-6df7-4575-acc2-d6cf1c818e10 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:30.916337 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ac83981f-6df7-4575-acc2-d6cf1c818e10 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:30.917146 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ac83981f-6df7-4575-acc2-d6cf1c818e10 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:30.918620 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ac83981f-6df7-4575-acc2-d6cf1c818e10 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:30.954703 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-ac83981f-6df7-4575-acc2-d6cf1c818e10 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Getting quotas for project 1743538991c8415394ac6cd5aed28d6a. Resources: {'ram', 'cores', 'instances'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:34:30.961746 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-ac83981f-6df7-4575-acc2-d6cf1c818e10 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Getting quotas for user 9b0455ae3ec94c929c940df6a0f6687d and project 1743538991c8415394ac6cd5aed28d6a. Resources: {'ram', 'cores', 'instances'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:34:30.979386 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ac83981f-6df7-4575-acc2-d6cf1c818e10 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Going to run 1 instances... {{(pid=127284) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:34:30.983177 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ac83981f-6df7-4575-acc2-d6cf1c818e10 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='da4af7b7-e205-4511-ad99-3478c2523f74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:34:31.095193 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fda403a7-f48d-4f35-ad26-3c9ff47abe31 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:31.105288 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-fda403a7-f48d-4f35-ad26-3c9ff47abe31 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1370 microversion: 2.1 time: 0.213324 Aug 19 16:34:31.106178 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 210/416] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:30 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1370 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:34:31.108633 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ac83981f-6df7-4575-acc2-d6cf1c818e10 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.975220 Aug 19 16:34:31.109927 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 207/417] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Aug 19 16:34:30 2022] POST /compute/v2.1/servers => generated 400 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 16:34:31.149028 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-05f9f74d-d69c-4702-baa0-bbbe45c92773 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:31.150010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-05f9f74d-d69c-4702-baa0-bbbe45c92773 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:31.236304 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-05f9f74d-d69c-4702-baa0-bbbe45c92773 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:31.244950 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-05f9f74d-d69c-4702-baa0-bbbe45c92773 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1240 microversion: 2.1 time: 0.109844 Aug 19 16:34:31.246020 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 211/418] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:31 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1240 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:31.853003 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2a1b3272-7c8e-4b14-bb89-7d516cc5e041 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:31.853890 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2a1b3272-7c8e-4b14-bb89-7d516cc5e041 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:31.864264 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2a1b3272-7c8e-4b14-bb89-7d516cc5e041 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:31.864779 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2a1b3272-7c8e-4b14-bb89-7d516cc5e041 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:31.865236 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2a1b3272-7c8e-4b14-bb89-7d516cc5e041 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:31.865938 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2a1b3272-7c8e-4b14-bb89-7d516cc5e041 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:31.867008 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2a1b3272-7c8e-4b14-bb89-7d516cc5e041 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:31.867617 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2a1b3272-7c8e-4b14-bb89-7d516cc5e041 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:32.032843 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2a1b3272-7c8e-4b14-bb89-7d516cc5e041 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:32.043317 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2a1b3272-7c8e-4b14-bb89-7d516cc5e041 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:32.046357 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2a1b3272-7c8e-4b14-bb89-7d516cc5e041 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:32.048257 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2a1b3272-7c8e-4b14-bb89-7d516cc5e041 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.200109 Aug 19 16:34:32.049345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 208/419] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:31 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:32.138020 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-cd3d8d39-53fe-4610-b91c-6add3e541e2a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:32.138761 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-cd3d8d39-53fe-4610-b91c-6add3e541e2a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:32.159944 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cd3d8d39-53fe-4610-b91c-6add3e541e2a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:32.160456 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cd3d8d39-53fe-4610-b91c-6add3e541e2a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:32.161110 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cd3d8d39-53fe-4610-b91c-6add3e541e2a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:32.162241 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cd3d8d39-53fe-4610-b91c-6add3e541e2a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:32.162706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cd3d8d39-53fe-4610-b91c-6add3e541e2a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:32.163192 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cd3d8d39-53fe-4610-b91c-6add3e541e2a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:32.267061 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-dea73921-fb41-40ac-8c00-91bd605666bc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:32.267680 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-dea73921-fb41-40ac-8c00-91bd605666bc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:32.276620 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dea73921-fb41-40ac-8c00-91bd605666bc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:32.278012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dea73921-fb41-40ac-8c00-91bd605666bc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:32.278481 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dea73921-fb41-40ac-8c00-91bd605666bc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:32.279202 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dea73921-fb41-40ac-8c00-91bd605666bc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:32.279661 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dea73921-fb41-40ac-8c00-91bd605666bc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:32.280146 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dea73921-fb41-40ac-8c00-91bd605666bc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:32.375334 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-dea73921-fb41-40ac-8c00-91bd605666bc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:32.381241 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-cd3d8d39-53fe-4610-b91c-6add3e541e2a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:32.391919 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-cd3d8d39-53fe-4610-b91c-6add3e541e2a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1370 microversion: 2.1 time: 0.260008 Aug 19 16:34:32.392510 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 212/420] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:32 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1370 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:32.405029 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-dea73921-fb41-40ac-8c00-91bd605666bc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1244 microversion: 2.1 time: 0.129513 Aug 19 16:34:32.405029 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 209/421] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:32 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1244 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:32.542919 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d7d55829-7dd0-46fe-8689-24a9469a69d8 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83b927ba-0195-493e-b8c8-6e583aa0f412", "device": "/dev/sdb"}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:34:32.546052 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d7d55829-7dd0-46fe-8689-24a9469a69d8 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:32.553136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d7d55829-7dd0-46fe-8689-24a9469a69d8 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:32.554728 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d7d55829-7dd0-46fe-8689-24a9469a69d8 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:32.555192 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d7d55829-7dd0-46fe-8689-24a9469a69d8 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:32.556013 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d7d55829-7dd0-46fe-8689-24a9469a69d8 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:32.556468 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d7d55829-7dd0-46fe-8689-24a9469a69d8 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:32.556922 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d7d55829-7dd0-46fe-8689-24a9469a69d8 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:33.074914 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-939d6651-4874-48d2-adfb-bb39bd69797a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:33.076041 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-939d6651-4874-48d2-adfb-bb39bd69797a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:33.091024 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-939d6651-4874-48d2-adfb-bb39bd69797a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:33.093661 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-939d6651-4874-48d2-adfb-bb39bd69797a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:33.095574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-939d6651-4874-48d2-adfb-bb39bd69797a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:33.096727 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-939d6651-4874-48d2-adfb-bb39bd69797a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:33.099548 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-939d6651-4874-48d2-adfb-bb39bd69797a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:33.100693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-939d6651-4874-48d2-adfb-bb39bd69797a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:33.293945 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d7d55829-7dd0-46fe-8689-24a9469a69d8 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "POST /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.755215 Aug 19 16:34:33.300867 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 213/422] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Aug 19 16:34:32 2022] POST /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32/os-volume_attachments => generated 194 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:34:33.420352 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-63cd1042-683c-46bf-a3aa-89d11bdd2915 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:33.421357 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-63cd1042-683c-46bf-a3aa-89d11bdd2915 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:33.434390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-63cd1042-683c-46bf-a3aa-89d11bdd2915 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:33.436828 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-63cd1042-683c-46bf-a3aa-89d11bdd2915 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:33.437455 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-63cd1042-683c-46bf-a3aa-89d11bdd2915 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:33.439358 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-63cd1042-683c-46bf-a3aa-89d11bdd2915 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:33.439358 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-63cd1042-683c-46bf-a3aa-89d11bdd2915 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:33.439358 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-63cd1042-683c-46bf-a3aa-89d11bdd2915 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:33.519620 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-939d6651-4874-48d2-adfb-bb39bd69797a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:33.531995 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-939d6651-4874-48d2-adfb-bb39bd69797a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:33.533518 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-939d6651-4874-48d2-adfb-bb39bd69797a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:33.534668 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-939d6651-4874-48d2-adfb-bb39bd69797a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1745 microversion: 2.20 time: 0.466913 Aug 19 16:34:33.542201 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 210/423] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:33 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1745 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:33.554113 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-30eec54c-faa5-47bc-9aac-1670f02b1bf0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:33.554960 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-30eec54c-faa5-47bc-9aac-1670f02b1bf0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:33.567511 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-30eec54c-faa5-47bc-9aac-1670f02b1bf0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:33.568631 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-30eec54c-faa5-47bc-9aac-1670f02b1bf0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:33.570115 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-30eec54c-faa5-47bc-9aac-1670f02b1bf0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:33.571431 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-30eec54c-faa5-47bc-9aac-1670f02b1bf0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:33.572289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-30eec54c-faa5-47bc-9aac-1670f02b1bf0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:33.572965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-30eec54c-faa5-47bc-9aac-1670f02b1bf0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:33.684551 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-30eec54c-faa5-47bc-9aac-1670f02b1bf0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:33.701514 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-30eec54c-faa5-47bc-9aac-1670f02b1bf0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1292 microversion: 2.1 time: 0.157601 Aug 19 16:34:33.713878 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 211/424] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:33 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1292 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:33.724356 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-63cd1042-683c-46bf-a3aa-89d11bdd2915 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:33.739078 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-63cd1042-683c-46bf-a3aa-89d11bdd2915 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1370 microversion: 2.1 time: 0.324852 Aug 19 16:34:33.740596 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 214/425] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:33 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1370 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:34.205605 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e3850201-a339-40df-85c7-6bf6bb68a87b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:34.206648 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-e3850201-a339-40df-85c7-6bf6bb68a87b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:34.214148 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e3850201-a339-40df-85c7-6bf6bb68a87b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:34.214905 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e3850201-a339-40df-85c7-6bf6bb68a87b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:34.215532 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e3850201-a339-40df-85c7-6bf6bb68a87b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:34.216310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e3850201-a339-40df-85c7-6bf6bb68a87b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:34.216950 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e3850201-a339-40df-85c7-6bf6bb68a87b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:34.217529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e3850201-a339-40df-85c7-6bf6bb68a87b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:34.245211 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e3850201-a339-40df-85c7-6bf6bb68a87b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199/ips" status: 200 len: 145 microversion: 2.1 time: 0.043578 Aug 19 16:34:34.245998 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 212/426] 10.222.0.55 () {58 vars in 1248 bytes} [Fri Aug 19 16:34:34 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:34:34.569164 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f69c2c59-338c-49f4-986f-87786b3cc7ac tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:34.572099 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f69c2c59-338c-49f4-986f-87786b3cc7ac tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:34.579558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f69c2c59-338c-49f4-986f-87786b3cc7ac tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:34.580050 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f69c2c59-338c-49f4-986f-87786b3cc7ac tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:34.580766 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f69c2c59-338c-49f4-986f-87786b3cc7ac tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:34.581529 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f69c2c59-338c-49f4-986f-87786b3cc7ac tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:34.581990 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f69c2c59-338c-49f4-986f-87786b3cc7ac tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:34.582598 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f69c2c59-338c-49f4-986f-87786b3cc7ac tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:34.728272 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f733c14b-81e1-459a-8bf3-fc7cbf19cf94 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:34.729496 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f733c14b-81e1-459a-8bf3-fc7cbf19cf94 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:34.741054 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f69c2c59-338c-49f4-986f-87786b3cc7ac tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:34.758638 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f69c2c59-338c-49f4-986f-87786b3cc7ac tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:34.761262 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f733c14b-81e1-459a-8bf3-fc7cbf19cf94 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:34.761929 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f733c14b-81e1-459a-8bf3-fc7cbf19cf94 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:34.764154 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f733c14b-81e1-459a-8bf3-fc7cbf19cf94 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:34.766012 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f69c2c59-338c-49f4-986f-87786b3cc7ac tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:34.766616 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f733c14b-81e1-459a-8bf3-fc7cbf19cf94 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:34.768724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f69c2c59-338c-49f4-986f-87786b3cc7ac tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1745 microversion: 2.20 time: 0.203423 Aug 19 16:34:34.769158 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f733c14b-81e1-459a-8bf3-fc7cbf19cf94 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:34.769737 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f733c14b-81e1-459a-8bf3-fc7cbf19cf94 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:34.771783 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 215/427] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:34 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1745 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:34.787312 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3351264e-00f9-429c-80b9-62e50b6da398 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:34.789435 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-3351264e-00f9-429c-80b9-62e50b6da398 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:34.803525 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3351264e-00f9-429c-80b9-62e50b6da398 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:34.804951 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3351264e-00f9-429c-80b9-62e50b6da398 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:34.805543 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3351264e-00f9-429c-80b9-62e50b6da398 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:34.806429 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3351264e-00f9-429c-80b9-62e50b6da398 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:34.810511 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3351264e-00f9-429c-80b9-62e50b6da398 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:34.811500 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3351264e-00f9-429c-80b9-62e50b6da398 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:34.949912 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f733c14b-81e1-459a-8bf3-fc7cbf19cf94 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:34.970984 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f733c14b-81e1-459a-8bf3-fc7cbf19cf94 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1298 microversion: 2.1 time: 0.243572 Aug 19 16:34:34.973870 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 213/428] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:34 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1298 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:34:35.190724 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-1b6761ef-113c-4695-931a-26ff4f67c686 req-c0aaafec-f521-49ab-afea-b68c1a70119b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894cc1e2-8a17-4de0-8127-b929095837d8", "name": "network-vif-plugged", "status": "completed", "tag": "72e0a5f4-4545-47a6-8d9a-ae53acb35877"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:34:35.247918 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-1b6761ef-113c-4695-931a-26ff4f67c686 req-c0aaafec-f521-49ab-afea-b68c1a70119b service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:35.248564 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-1b6761ef-113c-4695-931a-26ff4f67c686 req-c0aaafec-f521-49ab-afea-b68c1a70119b service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:35.250584 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-3351264e-00f9-429c-80b9-62e50b6da398 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:35.254052 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-1b6761ef-113c-4695-931a-26ff4f67c686 req-c0aaafec-f521-49ab-afea-b68c1a70119b service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:35.260170 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3351264e-00f9-429c-80b9-62e50b6da398 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1370 microversion: 2.1 time: 0.487042 Aug 19 16:34:35.280626 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 216/429] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:34 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1370 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:35.309011 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-1b6761ef-113c-4695-931a-26ff4f67c686 req-c0aaafec-f521-49ab-afea-b68c1a70119b service nova] Creating event network-vif-plugged:72e0a5f4-4545-47a6-8d9a-ae53acb35877 for instance 894cc1e2-8a17-4de0-8127-b929095837d8 on hv-cinder-83124 Aug 19 16:34:35.344591 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-1b6761ef-113c-4695-931a-26ff4f67c686 req-c0aaafec-f521-49ab-afea-b68c1a70119b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174275 Aug 19 16:34:35.345480 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 214/430] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:34:35.800069 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-fbb3cc0b-4a29-4830-9d0a-9aef803551d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:35.802433 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-fbb3cc0b-4a29-4830-9d0a-9aef803551d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:35.813373 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fbb3cc0b-4a29-4830-9d0a-9aef803551d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:35.814555 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fbb3cc0b-4a29-4830-9d0a-9aef803551d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:35.815301 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fbb3cc0b-4a29-4830-9d0a-9aef803551d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:35.817388 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fbb3cc0b-4a29-4830-9d0a-9aef803551d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:35.822316 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fbb3cc0b-4a29-4830-9d0a-9aef803551d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:35.823863 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fbb3cc0b-4a29-4830-9d0a-9aef803551d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:35.869381 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:34:35.994465 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ead524d2-9b74-4565-aaa9-4df7116f042a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:35.995265 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ead524d2-9b74-4565-aaa9-4df7116f042a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:36.013021 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ead524d2-9b74-4565-aaa9-4df7116f042a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:36.016125 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ead524d2-9b74-4565-aaa9-4df7116f042a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:36.016637 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ead524d2-9b74-4565-aaa9-4df7116f042a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:36.017618 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ead524d2-9b74-4565-aaa9-4df7116f042a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:36.018285 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ead524d2-9b74-4565-aaa9-4df7116f042a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:36.021318 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ead524d2-9b74-4565-aaa9-4df7116f042a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:36.186733 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fbb3cc0b-4a29-4830-9d0a-9aef803551d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:36.200708 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fbb3cc0b-4a29-4830-9d0a-9aef803551d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:36.206324 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fbb3cc0b-4a29-4830-9d0a-9aef803551d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:36.210569 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-fbb3cc0b-4a29-4830-9d0a-9aef803551d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1745 microversion: 2.20 time: 0.417858 Aug 19 16:34:36.211569 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 217/431] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:35 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1745 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:36.291651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a77030b4-a055-493c-a684-f5ecf70ddfe9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:36.293566 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a77030b4-a055-493c-a684-f5ecf70ddfe9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:36.307418 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a77030b4-a055-493c-a684-f5ecf70ddfe9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:36.308256 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a77030b4-a055-493c-a684-f5ecf70ddfe9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:36.309107 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a77030b4-a055-493c-a684-f5ecf70ddfe9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:36.312326 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a77030b4-a055-493c-a684-f5ecf70ddfe9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:36.313743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a77030b4-a055-493c-a684-f5ecf70ddfe9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:36.315891 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a77030b4-a055-493c-a684-f5ecf70ddfe9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:36.446742 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ead524d2-9b74-4565-aaa9-4df7116f042a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:36.465357 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ead524d2-9b74-4565-aaa9-4df7116f042a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1364 microversion: 2.1 time: 0.475897 Aug 19 16:34:36.467683 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 215/432] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:35 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1364 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:36.675102 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a77030b4-a055-493c-a684-f5ecf70ddfe9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:36.688634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a77030b4-a055-493c-a684-f5ecf70ddfe9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1370 microversion: 2.1 time: 0.406724 Aug 19 16:34:36.689618 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 218/433] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:36 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1370 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:34:37.034271 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-a806147c-e514-4e07-a1c6-e84963ff48af req-e00e296c-1cf4-4f39-b57e-b2944a6929c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66209407-a95b-4602-8c4c-b00baa5104e3", "tag": "10444959-dfba-4c06-911d-6a8b84b573d3"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:34:37.049825 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:34:37.053051 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-a806147c-e514-4e07-a1c6-e84963ff48af req-e00e296c-1cf4-4f39-b57e-b2944a6929c8 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:37.057258 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-a806147c-e514-4e07-a1c6-e84963ff48af req-e00e296c-1cf4-4f39-b57e-b2944a6929c8 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:37.058918 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-a806147c-e514-4e07-a1c6-e84963ff48af req-e00e296c-1cf4-4f39-b57e-b2944a6929c8 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:37.110888 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-a806147c-e514-4e07-a1c6-e84963ff48af req-e00e296c-1cf4-4f39-b57e-b2944a6929c8 service nova] Creating event network-changed:10444959-dfba-4c06-911d-6a8b84b573d3 for instance 66209407-a95b-4602-8c4c-b00baa5104e3 on hv-cinder-83124 Aug 19 16:34:37.132846 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-a806147c-e514-4e07-a1c6-e84963ff48af req-e00e296c-1cf4-4f39-b57e-b2944a6929c8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096091 Aug 19 16:34:37.132846 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 216/434] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:34:37.236686 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3499e85b-fee4-4a81-97eb-b999efa387c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:37.238162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-3499e85b-fee4-4a81-97eb-b999efa387c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:37.256225 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3499e85b-fee4-4a81-97eb-b999efa387c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:37.257519 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3499e85b-fee4-4a81-97eb-b999efa387c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:37.258205 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3499e85b-fee4-4a81-97eb-b999efa387c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:37.259089 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3499e85b-fee4-4a81-97eb-b999efa387c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:37.259692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3499e85b-fee4-4a81-97eb-b999efa387c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:37.260396 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3499e85b-fee4-4a81-97eb-b999efa387c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:37.490287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ebc3a7d9-a751-4078-bf43-e6d70304614b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:37.492900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ebc3a7d9-a751-4078-bf43-e6d70304614b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:37.501649 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ebc3a7d9-a751-4078-bf43-e6d70304614b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:37.502530 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ebc3a7d9-a751-4078-bf43-e6d70304614b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:37.503556 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ebc3a7d9-a751-4078-bf43-e6d70304614b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:37.504778 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ebc3a7d9-a751-4078-bf43-e6d70304614b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:37.505430 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ebc3a7d9-a751-4078-bf43-e6d70304614b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:37.506049 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ebc3a7d9-a751-4078-bf43-e6d70304614b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:37.517037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-3499e85b-fee4-4a81-97eb-b999efa387c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:37.530441 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-3499e85b-fee4-4a81-97eb-b999efa387c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:37.533373 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-3499e85b-fee4-4a81-97eb-b999efa387c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:37.538421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3499e85b-fee4-4a81-97eb-b999efa387c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1740 microversion: 2.20 time: 0.305777 Aug 19 16:34:37.541597 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 219/435] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:37 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1740 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:37.710631 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8c7c3c64-5087-4d49-89cb-d2f4ef69a6ae tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:37.711536 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8c7c3c64-5087-4d49-89cb-d2f4ef69a6ae tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:37.721786 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8c7c3c64-5087-4d49-89cb-d2f4ef69a6ae tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:37.722471 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8c7c3c64-5087-4d49-89cb-d2f4ef69a6ae tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:37.723625 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8c7c3c64-5087-4d49-89cb-d2f4ef69a6ae tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:37.725086 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8c7c3c64-5087-4d49-89cb-d2f4ef69a6ae tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:37.731729 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8c7c3c64-5087-4d49-89cb-d2f4ef69a6ae tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:37.732442 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8c7c3c64-5087-4d49-89cb-d2f4ef69a6ae tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:37.824519 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ebc3a7d9-a751-4078-bf43-e6d70304614b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:37.838860 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ebc3a7d9-a751-4078-bf43-e6d70304614b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1364 microversion: 2.1 time: 0.354832 Aug 19 16:34:37.853721 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 217/436] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:37 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1364 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:37.909047 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-b88f6d85-91aa-4a0e-a56b-1fe09721db24 req-3811329b-b776-40f3-8070-3a4de56337ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed4c246-7322-49b8-9bf7-2efaacc54b0b", "name": "network-vif-plugged", "status": "completed", "tag": "fe37ffff-6942-4410-8583-71fc27f97e1b"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:34:37.932405 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-b88f6d85-91aa-4a0e-a56b-1fe09721db24 req-3811329b-b776-40f3-8070-3a4de56337ee service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:37.933391 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-b88f6d85-91aa-4a0e-a56b-1fe09721db24 req-3811329b-b776-40f3-8070-3a4de56337ee service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:37.934178 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-b88f6d85-91aa-4a0e-a56b-1fe09721db24 req-3811329b-b776-40f3-8070-3a4de56337ee service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:37.958217 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-b88f6d85-91aa-4a0e-a56b-1fe09721db24 req-3811329b-b776-40f3-8070-3a4de56337ee service nova] Creating event network-vif-plugged:fe37ffff-6942-4410-8583-71fc27f97e1b for instance 9ed4c246-7322-49b8-9bf7-2efaacc54b0b on hv-cinder-83124 Aug 19 16:34:37.975947 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-b88f6d85-91aa-4a0e-a56b-1fe09721db24 req-3811329b-b776-40f3-8070-3a4de56337ee service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070709 Aug 19 16:34:37.976960 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 218/437] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:34:38.209438 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-8c7c3c64-5087-4d49-89cb-d2f4ef69a6ae tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:38.221151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8c7c3c64-5087-4d49-89cb-d2f4ef69a6ae tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1370 microversion: 2.1 time: 0.514659 Aug 19 16:34:38.221719 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 220/438] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:37 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1370 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:34:38.573221 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-22dc8b94-ed70-4a88-9f6f-47d672c410a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:38.575249 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-22dc8b94-ed70-4a88-9f6f-47d672c410a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:38.596811 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-22dc8b94-ed70-4a88-9f6f-47d672c410a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:38.601047 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-22dc8b94-ed70-4a88-9f6f-47d672c410a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:38.601861 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-22dc8b94-ed70-4a88-9f6f-47d672c410a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:38.603184 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-22dc8b94-ed70-4a88-9f6f-47d672c410a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:38.604993 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-22dc8b94-ed70-4a88-9f6f-47d672c410a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:38.607717 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-22dc8b94-ed70-4a88-9f6f-47d672c410a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:38.818155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-22dc8b94-ed70-4a88-9f6f-47d672c410a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:38.828213 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-22dc8b94-ed70-4a88-9f6f-47d672c410a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:38.829837 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-22dc8b94-ed70-4a88-9f6f-47d672c410a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:38.831247 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-22dc8b94-ed70-4a88-9f6f-47d672c410a2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1740 microversion: 2.20 time: 0.267708 Aug 19 16:34:38.844781 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 219/439] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:38 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1740 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:38.859870 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8fddef71-6c38-4391-9b8f-000cdd022530 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:38.860482 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8fddef71-6c38-4391-9b8f-000cdd022530 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:38.868792 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8fddef71-6c38-4391-9b8f-000cdd022530 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:38.869407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8fddef71-6c38-4391-9b8f-000cdd022530 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:38.869848 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8fddef71-6c38-4391-9b8f-000cdd022530 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:38.870667 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8fddef71-6c38-4391-9b8f-000cdd022530 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:38.871185 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8fddef71-6c38-4391-9b8f-000cdd022530 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:38.871614 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8fddef71-6c38-4391-9b8f-000cdd022530 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:39.147177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-8fddef71-6c38-4391-9b8f-000cdd022530 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:39.159900 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8fddef71-6c38-4391-9b8f-000cdd022530 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1364 microversion: 2.1 time: 0.304295 Aug 19 16:34:39.172929 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 221/440] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:38 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1364 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:39.245472 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-4001e8fb-4663-4bdc-9f27-fe72ad521279 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:39.246382 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-4001e8fb-4663-4bdc-9f27-fe72ad521279 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:39.259758 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4001e8fb-4663-4bdc-9f27-fe72ad521279 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:39.260405 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4001e8fb-4663-4bdc-9f27-fe72ad521279 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:39.261572 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4001e8fb-4663-4bdc-9f27-fe72ad521279 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:39.262668 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4001e8fb-4663-4bdc-9f27-fe72ad521279 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:39.263323 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4001e8fb-4663-4bdc-9f27-fe72ad521279 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:39.264077 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4001e8fb-4663-4bdc-9f27-fe72ad521279 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:39.432784 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-4001e8fb-4663-4bdc-9f27-fe72ad521279 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:39.440924 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-4001e8fb-4663-4bdc-9f27-fe72ad521279 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1370 microversion: 2.1 time: 0.201260 Aug 19 16:34:39.441688 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 220/441] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:39 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:39.857930 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-58638de4-cb11-441c-83ec-05b1785b579f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:39.860337 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-58638de4-cb11-441c-83ec-05b1785b579f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:39.889399 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:34:39.893657 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-58638de4-cb11-441c-83ec-05b1785b579f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:39.899383 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-58638de4-cb11-441c-83ec-05b1785b579f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:39.900425 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-58638de4-cb11-441c-83ec-05b1785b579f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:39.902065 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-58638de4-cb11-441c-83ec-05b1785b579f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:39.902971 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-58638de4-cb11-441c-83ec-05b1785b579f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:39.903699 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-58638de4-cb11-441c-83ec-05b1785b579f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:39.917309 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-9702ac1c-0196-4af7-b986-5d01a27cf307 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "799f882d-cb43-4af0-a9f4-e15c154e30f9"}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:34:39.920033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-9702ac1c-0196-4af7-b986-5d01a27cf307 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:39.932367 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9702ac1c-0196-4af7-b986-5d01a27cf307 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:39.933916 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9702ac1c-0196-4af7-b986-5d01a27cf307 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:39.937374 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9702ac1c-0196-4af7-b986-5d01a27cf307 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:39.938793 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9702ac1c-0196-4af7-b986-5d01a27cf307 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:39.941009 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9702ac1c-0196-4af7-b986-5d01a27cf307 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:39.942419 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9702ac1c-0196-4af7-b986-5d01a27cf307 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:40.122187 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-58638de4-cb11-441c-83ec-05b1785b579f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:40.131222 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-58638de4-cb11-441c-83ec-05b1785b579f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:40.133669 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-58638de4-cb11-441c-83ec-05b1785b579f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:40.135087 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-58638de4-cb11-441c-83ec-05b1785b579f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1740 microversion: 2.20 time: 0.281152 Aug 19 16:34:40.135952 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 222/442] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:39 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1740 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:40.180300 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-418ca1e3-aab1-472f-a1f7-14b44042bda4 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:40.185714 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-418ca1e3-aab1-472f-a1f7-14b44042bda4 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:40.195914 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-418ca1e3-aab1-472f-a1f7-14b44042bda4 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:40.196998 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-418ca1e3-aab1-472f-a1f7-14b44042bda4 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:40.198957 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-418ca1e3-aab1-472f-a1f7-14b44042bda4 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:40.199860 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-418ca1e3-aab1-472f-a1f7-14b44042bda4 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:40.201836 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-418ca1e3-aab1-472f-a1f7-14b44042bda4 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:40.202575 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-418ca1e3-aab1-472f-a1f7-14b44042bda4 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:40.398257 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-418ca1e3-aab1-472f-a1f7-14b44042bda4 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:40.410091 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-418ca1e3-aab1-472f-a1f7-14b44042bda4 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1364 microversion: 2.1 time: 0.234024 Aug 19 16:34:40.410971 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 223/443] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:40 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:40.468444 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8abd8665-df62-4fad-baa6-7a430a41a130 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:40.469482 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8abd8665-df62-4fad-baa6-7a430a41a130 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:40.476676 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8abd8665-df62-4fad-baa6-7a430a41a130 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:40.477203 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8abd8665-df62-4fad-baa6-7a430a41a130 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:40.477639 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8abd8665-df62-4fad-baa6-7a430a41a130 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:40.478332 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8abd8665-df62-4fad-baa6-7a430a41a130 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:40.478779 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8abd8665-df62-4fad-baa6-7a430a41a130 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:40.479197 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8abd8665-df62-4fad-baa6-7a430a41a130 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:40.682105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-8abd8665-df62-4fad-baa6-7a430a41a130 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:40.699602 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8abd8665-df62-4fad-baa6-7a430a41a130 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1370 microversion: 2.1 time: 0.234437 Aug 19 16:34:40.719682 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 224/444] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:40 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1370 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:40.938346 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=4 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:34:40.972597 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=16 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:34:41.159915 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0e40ca72-3790-464b-bbf9-9a6ddb543869 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:41.161133 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-0e40ca72-3790-464b-bbf9-9a6ddb543869 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:41.174326 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0e40ca72-3790-464b-bbf9-9a6ddb543869 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:41.175153 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0e40ca72-3790-464b-bbf9-9a6ddb543869 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:41.175550 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0e40ca72-3790-464b-bbf9-9a6ddb543869 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:41.178236 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0e40ca72-3790-464b-bbf9-9a6ddb543869 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:41.180256 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0e40ca72-3790-464b-bbf9-9a6ddb543869 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:41.183823 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0e40ca72-3790-464b-bbf9-9a6ddb543869 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:41.244417 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=8 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:34:41.439706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-0e40ca72-3790-464b-bbf9-9a6ddb543869 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:41.449941 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-0e40ca72-3790-464b-bbf9-9a6ddb543869 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:41.451892 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-0e40ca72-3790-464b-bbf9-9a6ddb543869 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:41.453518 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-0e40ca72-3790-464b-bbf9-9a6ddb543869 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1740 microversion: 2.20 time: 0.297696 Aug 19 16:34:41.465355 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 225/445] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:41 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1740 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:34:41.479283 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-57849bb9-cc4d-4373-b98e-e4bdc49e6792 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:41.491418 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-57849bb9-cc4d-4373-b98e-e4bdc49e6792 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:41.516201 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-57849bb9-cc4d-4373-b98e-e4bdc49e6792 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:41.519334 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-57849bb9-cc4d-4373-b98e-e4bdc49e6792 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:41.519786 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-57849bb9-cc4d-4373-b98e-e4bdc49e6792 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:41.523894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-57849bb9-cc4d-4373-b98e-e4bdc49e6792 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:41.524391 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-57849bb9-cc4d-4373-b98e-e4bdc49e6792 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:41.524868 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-57849bb9-cc4d-4373-b98e-e4bdc49e6792 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:41.688025 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-57849bb9-cc4d-4373-b98e-e4bdc49e6792 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:41.703836 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-57849bb9-cc4d-4373-b98e-e4bdc49e6792 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1364 microversion: 2.1 time: 0.231648 Aug 19 16:34:41.711313 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 226/446] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:41 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:41.738816 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-903c563c-f989-49ba-8a01-6eeeda4e8988 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:41.739669 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-903c563c-f989-49ba-8a01-6eeeda4e8988 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:41.746686 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-903c563c-f989-49ba-8a01-6eeeda4e8988 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:41.747627 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-903c563c-f989-49ba-8a01-6eeeda4e8988 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:41.748240 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-903c563c-f989-49ba-8a01-6eeeda4e8988 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:41.749185 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-903c563c-f989-49ba-8a01-6eeeda4e8988 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:41.750493 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-903c563c-f989-49ba-8a01-6eeeda4e8988 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:41.752094 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-903c563c-f989-49ba-8a01-6eeeda4e8988 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:41.977147 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-903c563c-f989-49ba-8a01-6eeeda4e8988 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:41.995027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-903c563c-f989-49ba-8a01-6eeeda4e8988 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1370 microversion: 2.1 time: 0.261595 Aug 19 16:34:41.995533 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 227/447] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:41 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1370 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:42.481577 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-548d351e-6791-4f9b-8cbb-20ee873ad25f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:42.482197 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-548d351e-6791-4f9b-8cbb-20ee873ad25f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:42.493717 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-548d351e-6791-4f9b-8cbb-20ee873ad25f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:42.495537 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-548d351e-6791-4f9b-8cbb-20ee873ad25f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:42.498079 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-548d351e-6791-4f9b-8cbb-20ee873ad25f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:42.500587 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-548d351e-6791-4f9b-8cbb-20ee873ad25f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:42.501680 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-548d351e-6791-4f9b-8cbb-20ee873ad25f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:42.502296 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-548d351e-6791-4f9b-8cbb-20ee873ad25f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:42.737620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-548d351e-6791-4f9b-8cbb-20ee873ad25f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:42.749332 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-548d351e-6791-4f9b-8cbb-20ee873ad25f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:42.750966 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-548d351e-6791-4f9b-8cbb-20ee873ad25f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:42.752526 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-548d351e-6791-4f9b-8cbb-20ee873ad25f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1740 microversion: 2.20 time: 0.275171 Aug 19 16:34:42.774554 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 228/448] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:42 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1740 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:42.781555 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b7d3dd03-00b9-4c3c-970c-fb560929b718 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:42.787442 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b7d3dd03-00b9-4c3c-970c-fb560929b718 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:42.795018 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b7d3dd03-00b9-4c3c-970c-fb560929b718 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:42.795974 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b7d3dd03-00b9-4c3c-970c-fb560929b718 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:42.796648 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b7d3dd03-00b9-4c3c-970c-fb560929b718 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:42.797596 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b7d3dd03-00b9-4c3c-970c-fb560929b718 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:42.798875 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b7d3dd03-00b9-4c3c-970c-fb560929b718 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:42.799515 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b7d3dd03-00b9-4c3c-970c-fb560929b718 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:43.065843 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b7d3dd03-00b9-4c3c-970c-fb560929b718 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:43.082953 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b7d3dd03-00b9-4c3c-970c-fb560929b718 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1364 microversion: 2.1 time: 0.305324 Aug 19 16:34:43.083970 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 229/449] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:42 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1364 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:43.091306 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-9c31a29c-0bed-48aa-92c1-5397785adcd1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:43.091929 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-9c31a29c-0bed-48aa-92c1-5397785adcd1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:43.120518 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9c31a29c-0bed-48aa-92c1-5397785adcd1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:43.121045 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9c31a29c-0bed-48aa-92c1-5397785adcd1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:43.123951 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9c31a29c-0bed-48aa-92c1-5397785adcd1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:43.126712 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9c31a29c-0bed-48aa-92c1-5397785adcd1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:43.127370 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9c31a29c-0bed-48aa-92c1-5397785adcd1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:43.128342 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9c31a29c-0bed-48aa-92c1-5397785adcd1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:43.318117 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-9c31a29c-0bed-48aa-92c1-5397785adcd1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:43.329270 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-9c31a29c-0bed-48aa-92c1-5397785adcd1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1564 microversion: 2.1 time: 0.242281 Aug 19 16:34:43.330108 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 230/450] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:43 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1564 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:43.364351 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d08b3988-438d-4d2f-8e8f-96bbf831e8ec tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:43.367406 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d08b3988-438d-4d2f-8e8f-96bbf831e8ec tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:43.374284 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d08b3988-438d-4d2f-8e8f-96bbf831e8ec tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:43.374853 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d08b3988-438d-4d2f-8e8f-96bbf831e8ec tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:43.375299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d08b3988-438d-4d2f-8e8f-96bbf831e8ec tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:43.376071 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d08b3988-438d-4d2f-8e8f-96bbf831e8ec tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:43.376536 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d08b3988-438d-4d2f-8e8f-96bbf831e8ec tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:43.377038 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d08b3988-438d-4d2f-8e8f-96bbf831e8ec tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:43.479182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d08b3988-438d-4d2f-8e8f-96bbf831e8ec tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.127508 Aug 19 16:34:43.480217 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 231/451] 10.222.0.55 () {58 vars in 1275 bytes} [Fri Aug 19 16:34:43 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:34:43.777029 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-7f33eb46-f64c-41e5-b5c4-60eb1137a727 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:43.778294 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-7f33eb46-f64c-41e5-b5c4-60eb1137a727 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:43.801334 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f33eb46-f64c-41e5-b5c4-60eb1137a727 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:43.805100 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f33eb46-f64c-41e5-b5c4-60eb1137a727 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:43.805541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f33eb46-f64c-41e5-b5c4-60eb1137a727 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:43.806272 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f33eb46-f64c-41e5-b5c4-60eb1137a727 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:43.806723 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f33eb46-f64c-41e5-b5c4-60eb1137a727 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:43.807145 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f33eb46-f64c-41e5-b5c4-60eb1137a727 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:43.937192 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:34:43.973666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-9702ac1c-0196-4af7-b986-5d01a27cf307 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "POST /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.061401 Aug 19 16:34:43.975082 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 221/452] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Aug 19 16:34:39 2022] POST /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199/os-volume_attachments => generated 194 bytes in 4064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:34:44.115640 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1d9be962-8a99-4641-a39d-a34542226e67 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:44.115640 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1d9be962-8a99-4641-a39d-a34542226e67 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:44.132472 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1d9be962-8a99-4641-a39d-a34542226e67 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:44.133126 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1d9be962-8a99-4641-a39d-a34542226e67 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:44.133644 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1d9be962-8a99-4641-a39d-a34542226e67 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:44.134601 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1d9be962-8a99-4641-a39d-a34542226e67 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:44.135149 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1d9be962-8a99-4641-a39d-a34542226e67 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:44.135849 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1d9be962-8a99-4641-a39d-a34542226e67 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:44.320449 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7f33eb46-f64c-41e5-b5c4-60eb1137a727 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:44.331033 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7f33eb46-f64c-41e5-b5c4-60eb1137a727 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:44.333091 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7f33eb46-f64c-41e5-b5c4-60eb1137a727 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:44.335133 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-7f33eb46-f64c-41e5-b5c4-60eb1137a727 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1740 microversion: 2.20 time: 0.563012 Aug 19 16:34:44.337334 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 232/453] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:43 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1740 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:34:44.546158 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1d9be962-8a99-4641-a39d-a34542226e67 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:44.565728 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1d9be962-8a99-4641-a39d-a34542226e67 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1364 microversion: 2.1 time: 0.456145 Aug 19 16:34:44.567705 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 222/454] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:44 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1364 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:45.359264 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1236c967-c3bc-4fbd-a689-150b57d0e5ae tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:45.359973 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-1236c967-c3bc-4fbd-a689-150b57d0e5ae tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:45.367921 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1236c967-c3bc-4fbd-a689-150b57d0e5ae tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:45.368659 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1236c967-c3bc-4fbd-a689-150b57d0e5ae tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:45.369274 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1236c967-c3bc-4fbd-a689-150b57d0e5ae tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:45.370191 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1236c967-c3bc-4fbd-a689-150b57d0e5ae tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:45.370636 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1236c967-c3bc-4fbd-a689-150b57d0e5ae tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:45.371213 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1236c967-c3bc-4fbd-a689-150b57d0e5ae tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:45.577871 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1236c967-c3bc-4fbd-a689-150b57d0e5ae tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:45.594443 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1236c967-c3bc-4fbd-a689-150b57d0e5ae tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:45.594877 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f6c33d17-c628-407b-914a-e22a11309306 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:45.596392 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f6c33d17-c628-407b-914a-e22a11309306 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:45.601284 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1236c967-c3bc-4fbd-a689-150b57d0e5ae tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:45.604717 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-1236c967-c3bc-4fbd-a689-150b57d0e5ae tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1740 microversion: 2.20 time: 0.249439 Aug 19 16:34:45.607111 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f6c33d17-c628-407b-914a-e22a11309306 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:45.608049 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f6c33d17-c628-407b-914a-e22a11309306 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:45.608731 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f6c33d17-c628-407b-914a-e22a11309306 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:45.608912 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 233/455] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:45 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1740 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:45.609794 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f6c33d17-c628-407b-914a-e22a11309306 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:45.610396 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f6c33d17-c628-407b-914a-e22a11309306 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:45.611049 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f6c33d17-c628-407b-914a-e22a11309306 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:45.918421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-5cc050bf-6447-461d-836e-d0d6baaae099 req-80f5c000-b1cc-432e-affe-4a5b200710ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ed4c246-7322-49b8-9bf7-2efaacc54b0b", "tag": "fe37ffff-6942-4410-8583-71fc27f97e1b"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:34:45.918959 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f6c33d17-c628-407b-914a-e22a11309306 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:45.935028 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-5cc050bf-6447-461d-836e-d0d6baaae099 req-80f5c000-b1cc-432e-affe-4a5b200710ca service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:45.935818 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-5cc050bf-6447-461d-836e-d0d6baaae099 req-80f5c000-b1cc-432e-affe-4a5b200710ca service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:45.935959 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f6c33d17-c628-407b-914a-e22a11309306 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1364 microversion: 2.1 time: 0.345087 Aug 19 16:34:45.937152 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-5cc050bf-6447-461d-836e-d0d6baaae099 req-80f5c000-b1cc-432e-affe-4a5b200710ca service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:45.937341 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 223/456] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:45 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1364 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:34:45.963381 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-5cc050bf-6447-461d-836e-d0d6baaae099 req-80f5c000-b1cc-432e-affe-4a5b200710ca service nova] Creating event network-changed:fe37ffff-6942-4410-8583-71fc27f97e1b for instance 9ed4c246-7322-49b8-9bf7-2efaacc54b0b on hv-cinder-83124 Aug 19 16:34:45.977348 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-5cc050bf-6447-461d-836e-d0d6baaae099 req-80f5c000-b1cc-432e-affe-4a5b200710ca service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063527 Aug 19 16:34:45.980935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 234/457] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:34:46.632065 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-5a52ff68-24ba-461e-9c85-a8e6a27b7379 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:46.633765 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-5a52ff68-24ba-461e-9c85-a8e6a27b7379 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:46.643270 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5a52ff68-24ba-461e-9c85-a8e6a27b7379 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:46.643997 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5a52ff68-24ba-461e-9c85-a8e6a27b7379 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:46.644648 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5a52ff68-24ba-461e-9c85-a8e6a27b7379 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:46.645944 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5a52ff68-24ba-461e-9c85-a8e6a27b7379 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:46.646648 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5a52ff68-24ba-461e-9c85-a8e6a27b7379 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:46.647349 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5a52ff68-24ba-461e-9c85-a8e6a27b7379 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:46.827831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-5a52ff68-24ba-461e-9c85-a8e6a27b7379 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:46.840217 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-5a52ff68-24ba-461e-9c85-a8e6a27b7379 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:46.842360 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-5a52ff68-24ba-461e-9c85-a8e6a27b7379 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:46.844188 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-5a52ff68-24ba-461e-9c85-a8e6a27b7379 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1740 microversion: 2.20 time: 0.217147 Aug 19 16:34:46.845341 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 224/458] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:46 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:46.966032 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-05c5663c-5473-4874-8852-8946a6deaf1f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:46.966819 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-05c5663c-5473-4874-8852-8946a6deaf1f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:46.974653 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-05c5663c-5473-4874-8852-8946a6deaf1f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:46.976064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-05c5663c-5473-4874-8852-8946a6deaf1f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:46.977030 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-05c5663c-5473-4874-8852-8946a6deaf1f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:46.978003 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-05c5663c-5473-4874-8852-8946a6deaf1f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:46.979503 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-05c5663c-5473-4874-8852-8946a6deaf1f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:46.980172 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-05c5663c-5473-4874-8852-8946a6deaf1f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:47.007190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=100 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:34:47.060226 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-113fe8a5-ea5e-45a8-aba7-ce9ea9b1d90d req-86f97bbc-70eb-4c74-9fa0-b2a38b6083db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66209407-a95b-4602-8c4c-b00baa5104e3", "name": "network-vif-plugged", "status": "completed", "tag": "10444959-dfba-4c06-911d-6a8b84b573d3"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:34:47.078191 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-113fe8a5-ea5e-45a8-aba7-ce9ea9b1d90d req-86f97bbc-70eb-4c74-9fa0-b2a38b6083db service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:47.079264 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-113fe8a5-ea5e-45a8-aba7-ce9ea9b1d90d req-86f97bbc-70eb-4c74-9fa0-b2a38b6083db service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:47.080510 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-113fe8a5-ea5e-45a8-aba7-ce9ea9b1d90d req-86f97bbc-70eb-4c74-9fa0-b2a38b6083db service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:47.132086 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-113fe8a5-ea5e-45a8-aba7-ce9ea9b1d90d req-86f97bbc-70eb-4c74-9fa0-b2a38b6083db service nova] Creating event network-vif-plugged:10444959-dfba-4c06-911d-6a8b84b573d3 for instance 66209407-a95b-4602-8c4c-b00baa5104e3 on hv-cinder-83124 Aug 19 16:34:47.153490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-113fe8a5-ea5e-45a8-aba7-ce9ea9b1d90d req-86f97bbc-70eb-4c74-9fa0-b2a38b6083db service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098153 Aug 19 16:34:47.158477 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 225/459] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:34:47.212091 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-05c5663c-5473-4874-8852-8946a6deaf1f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:47.222445 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-05c5663c-5473-4874-8852-8946a6deaf1f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1364 microversion: 2.1 time: 0.262168 Aug 19 16:34:47.223013 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 235/460] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:46 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:47.881787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1ce5219a-0787-4bf2-ab69-3f08647d96ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:47.882762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1ce5219a-0787-4bf2-ab69-3f08647d96ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:47.909222 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1ce5219a-0787-4bf2-ab69-3f08647d96ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:47.910111 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1ce5219a-0787-4bf2-ab69-3f08647d96ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:47.910730 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1ce5219a-0787-4bf2-ab69-3f08647d96ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:47.919501 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1ce5219a-0787-4bf2-ab69-3f08647d96ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:47.919989 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1ce5219a-0787-4bf2-ab69-3f08647d96ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:47.920477 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1ce5219a-0787-4bf2-ab69-3f08647d96ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:48.129499 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1ce5219a-0787-4bf2-ab69-3f08647d96ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:48.145440 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1ce5219a-0787-4bf2-ab69-3f08647d96ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:48.147241 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1ce5219a-0787-4bf2-ab69-3f08647d96ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:48.148621 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1ce5219a-0787-4bf2-ab69-3f08647d96ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1740 microversion: 2.20 time: 0.280761 Aug 19 16:34:48.149221 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 226/461] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:47 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:48.243285 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-13cebdf3-90a6-437d-b95a-cc9a66ca32d1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:48.243972 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-13cebdf3-90a6-437d-b95a-cc9a66ca32d1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:48.252853 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-13cebdf3-90a6-437d-b95a-cc9a66ca32d1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:48.253350 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-13cebdf3-90a6-437d-b95a-cc9a66ca32d1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:48.253969 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-13cebdf3-90a6-437d-b95a-cc9a66ca32d1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:48.254838 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-13cebdf3-90a6-437d-b95a-cc9a66ca32d1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:48.255825 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-13cebdf3-90a6-437d-b95a-cc9a66ca32d1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:48.257011 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-13cebdf3-90a6-437d-b95a-cc9a66ca32d1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:48.432703 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-13cebdf3-90a6-437d-b95a-cc9a66ca32d1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:48.442097 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-13cebdf3-90a6-437d-b95a-cc9a66ca32d1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1364 microversion: 2.1 time: 0.202682 Aug 19 16:34:48.457416 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 236/462] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:48 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:49.175162 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a764619e-c0fc-4eef-93cd-5072453acdc2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:49.175772 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a764619e-c0fc-4eef-93cd-5072453acdc2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:49.185561 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a764619e-c0fc-4eef-93cd-5072453acdc2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:49.186112 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a764619e-c0fc-4eef-93cd-5072453acdc2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:49.186634 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a764619e-c0fc-4eef-93cd-5072453acdc2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:49.187317 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a764619e-c0fc-4eef-93cd-5072453acdc2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:49.187890 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a764619e-c0fc-4eef-93cd-5072453acdc2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:49.188312 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a764619e-c0fc-4eef-93cd-5072453acdc2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:49.362882 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a764619e-c0fc-4eef-93cd-5072453acdc2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:49.372211 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a764619e-c0fc-4eef-93cd-5072453acdc2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:49.373738 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a764619e-c0fc-4eef-93cd-5072453acdc2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:49.375047 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a764619e-c0fc-4eef-93cd-5072453acdc2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1740 microversion: 2.20 time: 0.204539 Aug 19 16:34:49.376006 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 227/463] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:49 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:34:49.467183 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-710fac63-ddec-466f-bfa3-f39856a188b1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:49.468335 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-710fac63-ddec-466f-bfa3-f39856a188b1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:49.474775 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-710fac63-ddec-466f-bfa3-f39856a188b1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:49.475269 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-710fac63-ddec-466f-bfa3-f39856a188b1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:49.475715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-710fac63-ddec-466f-bfa3-f39856a188b1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:49.476419 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-710fac63-ddec-466f-bfa3-f39856a188b1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:49.477068 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-710fac63-ddec-466f-bfa3-f39856a188b1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:49.477650 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-710fac63-ddec-466f-bfa3-f39856a188b1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:49.816835 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-710fac63-ddec-466f-bfa3-f39856a188b1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:49.833745 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-710fac63-ddec-466f-bfa3-f39856a188b1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1364 microversion: 2.1 time: 0.369987 Aug 19 16:34:49.838305 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 237/464] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:49 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1364 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:50.399576 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7610c753-7a6a-4b20-9a60-cfaadca4e304 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:50.401235 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7610c753-7a6a-4b20-9a60-cfaadca4e304 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:50.413136 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7610c753-7a6a-4b20-9a60-cfaadca4e304 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:50.413637 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7610c753-7a6a-4b20-9a60-cfaadca4e304 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:50.414078 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7610c753-7a6a-4b20-9a60-cfaadca4e304 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:50.414797 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7610c753-7a6a-4b20-9a60-cfaadca4e304 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:50.415252 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7610c753-7a6a-4b20-9a60-cfaadca4e304 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:50.415681 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7610c753-7a6a-4b20-9a60-cfaadca4e304 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:50.642656 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7610c753-7a6a-4b20-9a60-cfaadca4e304 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:50.652925 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7610c753-7a6a-4b20-9a60-cfaadca4e304 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:50.654445 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7610c753-7a6a-4b20-9a60-cfaadca4e304 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:50.655631 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7610c753-7a6a-4b20-9a60-cfaadca4e304 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1740 microversion: 2.20 time: 0.261083 Aug 19 16:34:50.656192 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 228/465] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:50 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1740 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:50.857499 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8bb95536-0512-4e1d-bdf0-ff6f97865255 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:50.858143 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8bb95536-0512-4e1d-bdf0-ff6f97865255 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:50.871855 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8bb95536-0512-4e1d-bdf0-ff6f97865255 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:50.872354 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8bb95536-0512-4e1d-bdf0-ff6f97865255 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:50.872811 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8bb95536-0512-4e1d-bdf0-ff6f97865255 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:50.873558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8bb95536-0512-4e1d-bdf0-ff6f97865255 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:50.873982 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8bb95536-0512-4e1d-bdf0-ff6f97865255 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:50.874408 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8bb95536-0512-4e1d-bdf0-ff6f97865255 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:51.027400 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-8bb95536-0512-4e1d-bdf0-ff6f97865255 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:51.040036 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8bb95536-0512-4e1d-bdf0-ff6f97865255 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1364 microversion: 2.1 time: 0.185716 Aug 19 16:34:51.041557 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 238/466] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:50 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:51.681450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-4303c12f-0357-49a8-aee9-a50f8cb746e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:51.682086 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-4303c12f-0357-49a8-aee9-a50f8cb746e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:51.688561 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4303c12f-0357-49a8-aee9-a50f8cb746e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:51.689081 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4303c12f-0357-49a8-aee9-a50f8cb746e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:51.689520 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4303c12f-0357-49a8-aee9-a50f8cb746e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:51.690202 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4303c12f-0357-49a8-aee9-a50f8cb746e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:51.690653 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4303c12f-0357-49a8-aee9-a50f8cb746e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:51.691075 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4303c12f-0357-49a8-aee9-a50f8cb746e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:51.834650 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-4303c12f-0357-49a8-aee9-a50f8cb746e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:51.843008 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-4303c12f-0357-49a8-aee9-a50f8cb746e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:51.844497 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-4303c12f-0357-49a8-aee9-a50f8cb746e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:51.845669 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-4303c12f-0357-49a8-aee9-a50f8cb746e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1740 microversion: 2.20 time: 0.168884 Aug 19 16:34:51.846203 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 229/467] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:51 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:52.061428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ec51b88c-c40f-485e-807b-4cc44ec0f9f5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:52.062035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ec51b88c-c40f-485e-807b-4cc44ec0f9f5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:52.068576 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ec51b88c-c40f-485e-807b-4cc44ec0f9f5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:52.069086 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ec51b88c-c40f-485e-807b-4cc44ec0f9f5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:52.069521 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ec51b88c-c40f-485e-807b-4cc44ec0f9f5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:52.070203 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ec51b88c-c40f-485e-807b-4cc44ec0f9f5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:52.070657 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ec51b88c-c40f-485e-807b-4cc44ec0f9f5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:52.071083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ec51b88c-c40f-485e-807b-4cc44ec0f9f5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:52.199511 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ec51b88c-c40f-485e-807b-4cc44ec0f9f5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:52.207402 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ec51b88c-c40f-485e-807b-4cc44ec0f9f5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1364 microversion: 2.1 time: 0.149818 Aug 19 16:34:52.207963 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 239/468] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:52 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:52.869456 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-43b89e31-c996-4567-aa92-22c50c39a8dc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:52.870010 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-43b89e31-c996-4567-aa92-22c50c39a8dc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:52.876337 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-43b89e31-c996-4567-aa92-22c50c39a8dc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:52.876833 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-43b89e31-c996-4567-aa92-22c50c39a8dc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:52.877268 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-43b89e31-c996-4567-aa92-22c50c39a8dc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:52.877967 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-43b89e31-c996-4567-aa92-22c50c39a8dc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:52.878403 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-43b89e31-c996-4567-aa92-22c50c39a8dc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:52.878823 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-43b89e31-c996-4567-aa92-22c50c39a8dc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:53.006788 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-43b89e31-c996-4567-aa92-22c50c39a8dc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:53.015037 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-43b89e31-c996-4567-aa92-22c50c39a8dc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:53.016541 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-43b89e31-c996-4567-aa92-22c50c39a8dc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:53.017741 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-43b89e31-c996-4567-aa92-22c50c39a8dc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1740 microversion: 2.20 time: 0.153005 Aug 19 16:34:53.018306 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 230/469] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:52 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:53.227827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-33fcdc54-617d-4576-8f84-94042c16452a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:53.228438 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-33fcdc54-617d-4576-8f84-94042c16452a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:53.234917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-33fcdc54-617d-4576-8f84-94042c16452a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:53.235394 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-33fcdc54-617d-4576-8f84-94042c16452a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:53.235832 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-33fcdc54-617d-4576-8f84-94042c16452a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:53.236544 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-33fcdc54-617d-4576-8f84-94042c16452a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:53.237024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-33fcdc54-617d-4576-8f84-94042c16452a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:53.237474 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-33fcdc54-617d-4576-8f84-94042c16452a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:53.367903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-33fcdc54-617d-4576-8f84-94042c16452a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:53.375514 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-33fcdc54-617d-4576-8f84-94042c16452a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1364 microversion: 2.1 time: 0.151990 Aug 19 16:34:53.376071 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 240/470] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:53 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:34:54.040261 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b6909fa3-d6c2-4714-9e0d-5ae708f61e3b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:54.040925 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-b6909fa3-d6c2-4714-9e0d-5ae708f61e3b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:54.047360 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b6909fa3-d6c2-4714-9e0d-5ae708f61e3b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:54.047839 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b6909fa3-d6c2-4714-9e0d-5ae708f61e3b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:54.048275 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b6909fa3-d6c2-4714-9e0d-5ae708f61e3b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:54.049087 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b6909fa3-d6c2-4714-9e0d-5ae708f61e3b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:54.049541 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b6909fa3-d6c2-4714-9e0d-5ae708f61e3b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:54.049963 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b6909fa3-d6c2-4714-9e0d-5ae708f61e3b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:54.180476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b6909fa3-d6c2-4714-9e0d-5ae708f61e3b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:54.188672 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b6909fa3-d6c2-4714-9e0d-5ae708f61e3b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:54.190193 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b6909fa3-d6c2-4714-9e0d-5ae708f61e3b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:54.191342 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b6909fa3-d6c2-4714-9e0d-5ae708f61e3b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1740 microversion: 2.20 time: 0.155037 Aug 19 16:34:54.191882 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 231/471] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:54 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:54.395287 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-fea94652-f546-4812-b833-2429e4874367 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:54.395939 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-fea94652-f546-4812-b833-2429e4874367 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:54.403203 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fea94652-f546-4812-b833-2429e4874367 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:54.403689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fea94652-f546-4812-b833-2429e4874367 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:54.404257 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fea94652-f546-4812-b833-2429e4874367 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:54.405137 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fea94652-f546-4812-b833-2429e4874367 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:54.405671 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fea94652-f546-4812-b833-2429e4874367 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:54.406244 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fea94652-f546-4812-b833-2429e4874367 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:54.532502 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fea94652-f546-4812-b833-2429e4874367 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:54.540727 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-fea94652-f546-4812-b833-2429e4874367 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1364 microversion: 2.1 time: 0.149338 Aug 19 16:34:54.541308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 241/472] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:54 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:55.214121 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-19e4eeac-d282-45f7-b820-16d425587641 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:55.214648 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-19e4eeac-d282-45f7-b820-16d425587641 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:55.220984 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-19e4eeac-d282-45f7-b820-16d425587641 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:55.221457 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-19e4eeac-d282-45f7-b820-16d425587641 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:55.221884 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-19e4eeac-d282-45f7-b820-16d425587641 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:55.222558 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-19e4eeac-d282-45f7-b820-16d425587641 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:55.223002 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-19e4eeac-d282-45f7-b820-16d425587641 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:55.223414 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-19e4eeac-d282-45f7-b820-16d425587641 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:55.352929 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-19e4eeac-d282-45f7-b820-16d425587641 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:55.361207 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-19e4eeac-d282-45f7-b820-16d425587641 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:55.362734 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-19e4eeac-d282-45f7-b820-16d425587641 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:55.363883 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-19e4eeac-d282-45f7-b820-16d425587641 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1740 microversion: 2.20 time: 0.153745 Aug 19 16:34:55.364439 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 232/473] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:55 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:55.560342 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-5417c690-94fb-4af6-b1f7-27ecafa34c02 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:55.560959 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-5417c690-94fb-4af6-b1f7-27ecafa34c02 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:55.567419 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5417c690-94fb-4af6-b1f7-27ecafa34c02 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:55.567945 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5417c690-94fb-4af6-b1f7-27ecafa34c02 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:55.569177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5417c690-94fb-4af6-b1f7-27ecafa34c02 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:55.570026 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5417c690-94fb-4af6-b1f7-27ecafa34c02 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:55.570557 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5417c690-94fb-4af6-b1f7-27ecafa34c02 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:55.570982 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5417c690-94fb-4af6-b1f7-27ecafa34c02 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:55.705450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5417c690-94fb-4af6-b1f7-27ecafa34c02 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:55.713052 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-5417c690-94fb-4af6-b1f7-27ecafa34c02 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1364 microversion: 2.1 time: 0.156510 Aug 19 16:34:55.713619 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 242/474] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:55 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:56.386202 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-49b69e76-5a91-4e60-b563-d0d2d052fd5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:56.386809 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-49b69e76-5a91-4e60-b563-d0d2d052fd5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:56.393176 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-49b69e76-5a91-4e60-b563-d0d2d052fd5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:56.393662 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-49b69e76-5a91-4e60-b563-d0d2d052fd5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:56.394137 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-49b69e76-5a91-4e60-b563-d0d2d052fd5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:56.394828 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-49b69e76-5a91-4e60-b563-d0d2d052fd5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:56.395277 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-49b69e76-5a91-4e60-b563-d0d2d052fd5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:56.395700 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-49b69e76-5a91-4e60-b563-d0d2d052fd5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:56.529745 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-49b69e76-5a91-4e60-b563-d0d2d052fd5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:56.539160 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-49b69e76-5a91-4e60-b563-d0d2d052fd5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:56.540899 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-49b69e76-5a91-4e60-b563-d0d2d052fd5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:56.542071 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-49b69e76-5a91-4e60-b563-d0d2d052fd5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1740 microversion: 2.20 time: 0.159781 Aug 19 16:34:56.550810 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 233/475] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:56 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:34:56.733724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c2e81102-0b89-44fb-b992-893630d07e57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:56.734327 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c2e81102-0b89-44fb-b992-893630d07e57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:56.740886 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2e81102-0b89-44fb-b992-893630d07e57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:56.741371 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2e81102-0b89-44fb-b992-893630d07e57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:56.741800 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2e81102-0b89-44fb-b992-893630d07e57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:56.742482 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2e81102-0b89-44fb-b992-893630d07e57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:56.742929 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2e81102-0b89-44fb-b992-893630d07e57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:56.743345 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c2e81102-0b89-44fb-b992-893630d07e57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:56.879564 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c2e81102-0b89-44fb-b992-893630d07e57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:56.887861 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c2e81102-0b89-44fb-b992-893630d07e57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1554 microversion: 2.1 time: 0.158108 Aug 19 16:34:56.888568 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 243/476] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:34:56 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:34:56.909404 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-38770151-d71b-4c18-b318-1c9dbc965b13 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:56.909952 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-38770151-d71b-4c18-b318-1c9dbc965b13 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:56.916285 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-38770151-d71b-4c18-b318-1c9dbc965b13 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:56.916798 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-38770151-d71b-4c18-b318-1c9dbc965b13 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:56.917244 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-38770151-d71b-4c18-b318-1c9dbc965b13 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:56.917938 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-38770151-d71b-4c18-b318-1c9dbc965b13 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:56.918391 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-38770151-d71b-4c18-b318-1c9dbc965b13 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:56.918819 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-38770151-d71b-4c18-b318-1c9dbc965b13 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:56.999512 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-38770151-d71b-4c18-b318-1c9dbc965b13 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093882 Aug 19 16:34:57.008489 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 234/477] 10.222.0.55 () {58 vars in 1275 bytes} [Fri Aug 19 16:34:56 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:34:57.564902 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c10aa226-f853-413e-b27c-ad7b4614486d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:57.565689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c10aa226-f853-413e-b27c-ad7b4614486d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:57.572408 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c10aa226-f853-413e-b27c-ad7b4614486d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:57.573067 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c10aa226-f853-413e-b27c-ad7b4614486d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:57.573596 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c10aa226-f853-413e-b27c-ad7b4614486d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:57.574595 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c10aa226-f853-413e-b27c-ad7b4614486d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:57.575116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c10aa226-f853-413e-b27c-ad7b4614486d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:57.575734 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c10aa226-f853-413e-b27c-ad7b4614486d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:57.749621 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c10aa226-f853-413e-b27c-ad7b4614486d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:57.758209 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c10aa226-f853-413e-b27c-ad7b4614486d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:57.759698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c10aa226-f853-413e-b27c-ad7b4614486d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:57.760874 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c10aa226-f853-413e-b27c-ad7b4614486d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1740 microversion: 2.20 time: 0.199876 Aug 19 16:34:57.769286 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 244/478] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:57 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:34:58.070461 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-7d7ca94d-862b-4ab3-884d-13c1623a0049 req-5f09d481-da33-4122-8bba-29f755c376ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66209407-a95b-4602-8c4c-b00baa5104e3", "tag": "10444959-dfba-4c06-911d-6a8b84b573d3"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:34:58.080920 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-7d7ca94d-862b-4ab3-884d-13c1623a0049 req-5f09d481-da33-4122-8bba-29f755c376ad service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:58.081670 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-7d7ca94d-862b-4ab3-884d-13c1623a0049 req-5f09d481-da33-4122-8bba-29f755c376ad service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:58.082185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-7d7ca94d-862b-4ab3-884d-13c1623a0049 req-5f09d481-da33-4122-8bba-29f755c376ad service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:58.096817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-7d7ca94d-862b-4ab3-884d-13c1623a0049 req-5f09d481-da33-4122-8bba-29f755c376ad service nova] Creating event network-changed:10444959-dfba-4c06-911d-6a8b84b573d3 for instance 66209407-a95b-4602-8c4c-b00baa5104e3 on hv-cinder-83124 Aug 19 16:34:58.106365 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-7d7ca94d-862b-4ab3-884d-13c1623a0049 req-5f09d481-da33-4122-8bba-29f755c376ad service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039858 Aug 19 16:34:58.107709 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 235/479] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:34:58.784917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ef8ca220-cf76-4f52-8da6-8bba1f7fb06b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:34:58.785613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ef8ca220-cf76-4f52-8da6-8bba1f7fb06b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:34:58.792731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ef8ca220-cf76-4f52-8da6-8bba1f7fb06b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:58.793371 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ef8ca220-cf76-4f52-8da6-8bba1f7fb06b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:58.793951 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ef8ca220-cf76-4f52-8da6-8bba1f7fb06b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:58.794854 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ef8ca220-cf76-4f52-8da6-8bba1f7fb06b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:34:58.795523 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ef8ca220-cf76-4f52-8da6-8bba1f7fb06b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:34:58.796023 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ef8ca220-cf76-4f52-8da6-8bba1f7fb06b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:34:59.009548 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ef8ca220-cf76-4f52-8da6-8bba1f7fb06b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:59.023081 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ef8ca220-cf76-4f52-8da6-8bba1f7fb06b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:59.025478 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ef8ca220-cf76-4f52-8da6-8bba1f7fb06b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:34:59.026922 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ef8ca220-cf76-4f52-8da6-8bba1f7fb06b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1740 microversion: 2.20 time: 0.247046 Aug 19 16:34:59.028281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 245/480] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:34:58 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1740 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:00.052883 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b476497c-f66c-4975-b874-de577823ac89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:00.053898 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-b476497c-f66c-4975-b874-de577823ac89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:00.060541 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b476497c-f66c-4975-b874-de577823ac89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:00.061131 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b476497c-f66c-4975-b874-de577823ac89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:00.061658 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b476497c-f66c-4975-b874-de577823ac89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:00.062421 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b476497c-f66c-4975-b874-de577823ac89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:00.062944 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b476497c-f66c-4975-b874-de577823ac89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:00.063432 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b476497c-f66c-4975-b874-de577823ac89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:00.534105 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b476497c-f66c-4975-b874-de577823ac89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:00.543794 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b476497c-f66c-4975-b874-de577823ac89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:00.545565 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b476497c-f66c-4975-b874-de577823ac89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:00.547247 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b476497c-f66c-4975-b874-de577823ac89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1740 microversion: 2.20 time: 0.499872 Aug 19 16:35:00.563491 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 236/481] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:00 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1740 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:01.544578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4dd8585a-f656-47b2-ba71-f67ef0a2945f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:35:01.557842 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4dd8585a-f656-47b2-ba71-f67ef0a2945f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:01.558728 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4dd8585a-f656-47b2-ba71-f67ef0a2945f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:01.559526 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4dd8585a-f656-47b2-ba71-f67ef0a2945f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:01.572118 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e66acd68-343f-4fa4-87aa-fd905b4646a3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:01.572725 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-e66acd68-343f-4fa4-87aa-fd905b4646a3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:01.590670 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e66acd68-343f-4fa4-87aa-fd905b4646a3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:01.595249 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e66acd68-343f-4fa4-87aa-fd905b4646a3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:01.595743 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e66acd68-343f-4fa4-87aa-fd905b4646a3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:01.596502 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e66acd68-343f-4fa4-87aa-fd905b4646a3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:01.596981 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e66acd68-343f-4fa4-87aa-fd905b4646a3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:01.598512 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e66acd68-343f-4fa4-87aa-fd905b4646a3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:01.703054 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-4dd8585a-f656-47b2-ba71-f67ef0a2945f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Going to try to stop instance {{(pid=127285) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 19 16:35:01.765762 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4dd8585a-f656-47b2-ba71-f67ef0a2945f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "POST /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199/action" status: 202 len: 0 microversion: 2.1 time: 0.225588 Aug 19 16:35:01.767258 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 246/482] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Aug 19 16:35:01 2022] POST /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:35:01.786282 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e6f156f0-38fd-4847-9218-554ac45c06cc tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:01.788667 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e6f156f0-38fd-4847-9218-554ac45c06cc tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:01.807396 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e6f156f0-38fd-4847-9218-554ac45c06cc tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:01.808541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e6f156f0-38fd-4847-9218-554ac45c06cc tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:01.809190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e6f156f0-38fd-4847-9218-554ac45c06cc tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:01.810205 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e6f156f0-38fd-4847-9218-554ac45c06cc tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:01.811170 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e6f156f0-38fd-4847-9218-554ac45c06cc tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:01.811750 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e6f156f0-38fd-4847-9218-554ac45c06cc tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:01.930411 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e66acd68-343f-4fa4-87aa-fd905b4646a3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:01.946997 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e66acd68-343f-4fa4-87aa-fd905b4646a3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:01.950807 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e66acd68-343f-4fa4-87aa-fd905b4646a3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:01.952662 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e66acd68-343f-4fa4-87aa-fd905b4646a3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1722 microversion: 2.20 time: 0.386480 Aug 19 16:35:01.965938 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 237/483] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:01 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1722 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:35:02.106716 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e6f156f0-38fd-4847-9218-554ac45c06cc tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:02.121983 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e6f156f0-38fd-4847-9218-554ac45c06cc tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.349331 Aug 19 16:35:02.123756 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 247/484] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:01 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:02.913124 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-bdb3f46d-7f4f-40f4-bff7-b36f24315b65 req-68857b5a-15bb-4fe1-a30e-d1760febba12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894cc1e2-8a17-4de0-8127-b929095837d8", "name": "network-vif-unplugged", "status": "completed", "tag": "72e0a5f4-4545-47a6-8d9a-ae53acb35877"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:35:02.924436 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-bdb3f46d-7f4f-40f4-bff7-b36f24315b65 req-68857b5a-15bb-4fe1-a30e-d1760febba12 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:02.925082 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-bdb3f46d-7f4f-40f4-bff7-b36f24315b65 req-68857b5a-15bb-4fe1-a30e-d1760febba12 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:02.925685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-bdb3f46d-7f4f-40f4-bff7-b36f24315b65 req-68857b5a-15bb-4fe1-a30e-d1760febba12 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:02.938850 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-bdb3f46d-7f4f-40f4-bff7-b36f24315b65 req-68857b5a-15bb-4fe1-a30e-d1760febba12 service nova] Creating event network-vif-unplugged:72e0a5f4-4545-47a6-8d9a-ae53acb35877 for instance 894cc1e2-8a17-4de0-8127-b929095837d8 on hv-cinder-83124 Aug 19 16:35:02.945446 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-bdb3f46d-7f4f-40f4-bff7-b36f24315b65 req-68857b5a-15bb-4fe1-a30e-d1760febba12 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035934 Aug 19 16:35:02.946342 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 238/485] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:35:02.978576 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-17c1da1a-3655-453b-a5fb-fe0df5803e2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:02.979307 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-17c1da1a-3655-453b-a5fb-fe0df5803e2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:02.986108 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-17c1da1a-3655-453b-a5fb-fe0df5803e2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:02.987186 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-17c1da1a-3655-453b-a5fb-fe0df5803e2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:02.987186 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-17c1da1a-3655-453b-a5fb-fe0df5803e2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:02.987799 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-17c1da1a-3655-453b-a5fb-fe0df5803e2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:02.988973 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-17c1da1a-3655-453b-a5fb-fe0df5803e2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:02.989789 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-17c1da1a-3655-453b-a5fb-fe0df5803e2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:03.144727 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ccdec378-5ee6-4b3a-9bbe-c3a2b1d481bb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:03.145997 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ccdec378-5ee6-4b3a-9bbe-c3a2b1d481bb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:03.163802 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ccdec378-5ee6-4b3a-9bbe-c3a2b1d481bb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:03.164039 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-17c1da1a-3655-453b-a5fb-fe0df5803e2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:03.164849 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ccdec378-5ee6-4b3a-9bbe-c3a2b1d481bb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:03.165628 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ccdec378-5ee6-4b3a-9bbe-c3a2b1d481bb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:03.166718 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ccdec378-5ee6-4b3a-9bbe-c3a2b1d481bb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:03.168004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ccdec378-5ee6-4b3a-9bbe-c3a2b1d481bb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:03.168826 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ccdec378-5ee6-4b3a-9bbe-c3a2b1d481bb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:03.173633 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-17c1da1a-3655-453b-a5fb-fe0df5803e2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:03.175632 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-17c1da1a-3655-453b-a5fb-fe0df5803e2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:03.177994 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-17c1da1a-3655-453b-a5fb-fe0df5803e2e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1722 microversion: 2.20 time: 0.202850 Aug 19 16:35:03.189925 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 248/486] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:02 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:03.477362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ccdec378-5ee6-4b3a-9bbe-c3a2b1d481bb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:03.486603 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ccdec378-5ee6-4b3a-9bbe-c3a2b1d481bb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.346632 Aug 19 16:35:03.487723 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 239/487] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:03 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:03.806663 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1f1fe712-f22c-4f6b-9d5f-26cfe72ab6ba tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:03.807271 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-1f1fe712-f22c-4f6b-9d5f-26cfe72ab6ba tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:03.813238 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1f1fe712-f22c-4f6b-9d5f-26cfe72ab6ba tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:03.813798 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1f1fe712-f22c-4f6b-9d5f-26cfe72ab6ba tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:03.814247 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1f1fe712-f22c-4f6b-9d5f-26cfe72ab6ba tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:03.814933 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1f1fe712-f22c-4f6b-9d5f-26cfe72ab6ba tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:03.815406 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1f1fe712-f22c-4f6b-9d5f-26cfe72ab6ba tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:03.815824 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1f1fe712-f22c-4f6b-9d5f-26cfe72ab6ba tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:03.957006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.objects.instance [None req-1f1fe712-f22c-4f6b-9d5f-26cfe72ab6ba tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lazy-loading 'services' on Instance uuid 38a84b78-4b40-4cfe-b649-528c7dad0f32 {{(pid=127285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:35:04.088328 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-1f1fe712-f22c-4f6b-9d5f-26cfe72ab6ba tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "DELETE /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32/os-volume_attachments/83b927ba-0195-493e-b8c8-6e583aa0f412" status: 202 len: 0 microversion: 2.1 time: 0.286106 Aug 19 16:35:04.089248 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 249/488] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Aug 19 16:35:03 2022] DELETE /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32/os-volume_attachments/83b927ba-0195-493e-b8c8-6e583aa0f412 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:35:04.202047 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-62c00893-72f5-4fcb-b1f2-6d1751315045 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:04.202786 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-62c00893-72f5-4fcb-b1f2-6d1751315045 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:04.210254 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-62c00893-72f5-4fcb-b1f2-6d1751315045 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:04.210823 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-62c00893-72f5-4fcb-b1f2-6d1751315045 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:04.211148 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-62c00893-72f5-4fcb-b1f2-6d1751315045 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:04.211892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-62c00893-72f5-4fcb-b1f2-6d1751315045 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:04.212362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-62c00893-72f5-4fcb-b1f2-6d1751315045 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:04.212830 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-62c00893-72f5-4fcb-b1f2-6d1751315045 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:04.232326 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:35:04.399289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-62c00893-72f5-4fcb-b1f2-6d1751315045 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:04.408647 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-62c00893-72f5-4fcb-b1f2-6d1751315045 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:04.410248 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-62c00893-72f5-4fcb-b1f2-6d1751315045 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:04.411688 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-62c00893-72f5-4fcb-b1f2-6d1751315045 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1722 microversion: 2.20 time: 0.213357 Aug 19 16:35:04.412639 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 240/489] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:04 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:04.509138 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-5e6b142a-5e00-45fb-89ae-97837f35fce3 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:04.510161 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-5e6b142a-5e00-45fb-89ae-97837f35fce3 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:04.516346 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5e6b142a-5e00-45fb-89ae-97837f35fce3 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:04.517055 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5e6b142a-5e00-45fb-89ae-97837f35fce3 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:04.517489 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5e6b142a-5e00-45fb-89ae-97837f35fce3 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:04.518188 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5e6b142a-5e00-45fb-89ae-97837f35fce3 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:04.518668 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5e6b142a-5e00-45fb-89ae-97837f35fce3 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:04.519097 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5e6b142a-5e00-45fb-89ae-97837f35fce3 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:04.524279 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:35:04.749594 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5e6b142a-5e00-45fb-89ae-97837f35fce3 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:04.760958 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-5e6b142a-5e00-45fb-89ae-97837f35fce3 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.257040 Aug 19 16:35:04.761581 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 250/490] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:04 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:05.434935 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8e3f936f-f6db-4c05-ab88-641df3d71f0c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:05.435544 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8e3f936f-f6db-4c05-ab88-641df3d71f0c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:05.452553 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8e3f936f-f6db-4c05-ab88-641df3d71f0c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:05.453107 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8e3f936f-f6db-4c05-ab88-641df3d71f0c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:05.453557 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8e3f936f-f6db-4c05-ab88-641df3d71f0c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:05.454531 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8e3f936f-f6db-4c05-ab88-641df3d71f0c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:05.454991 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8e3f936f-f6db-4c05-ab88-641df3d71f0c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:05.455416 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8e3f936f-f6db-4c05-ab88-641df3d71f0c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:05.625364 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8e3f936f-f6db-4c05-ab88-641df3d71f0c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:05.636295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8e3f936f-f6db-4c05-ab88-641df3d71f0c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:05.638067 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8e3f936f-f6db-4c05-ab88-641df3d71f0c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:05.639395 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8e3f936f-f6db-4c05-ab88-641df3d71f0c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1722 microversion: 2.20 time: 0.208498 Aug 19 16:35:05.640423 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 241/491] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:05 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:05.789823 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-53352dff-2cef-4cd4-b999-4470915e7c58 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:05.791690 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-53352dff-2cef-4cd4-b999-4470915e7c58 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:05.809878 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-53352dff-2cef-4cd4-b999-4470915e7c58 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:05.810778 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-53352dff-2cef-4cd4-b999-4470915e7c58 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:05.811358 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-53352dff-2cef-4cd4-b999-4470915e7c58 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:05.812065 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-53352dff-2cef-4cd4-b999-4470915e7c58 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:05.813050 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-53352dff-2cef-4cd4-b999-4470915e7c58 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:05.813423 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-53352dff-2cef-4cd4-b999-4470915e7c58 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:06.252840 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-53352dff-2cef-4cd4-b999-4470915e7c58 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:06.268649 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-53352dff-2cef-4cd4-b999-4470915e7c58 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.487204 Aug 19 16:35:06.269723 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 251/492] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:05 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:06.664961 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7172c534-2d99-4497-a2f0-fa240862a3c3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:06.665575 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7172c534-2d99-4497-a2f0-fa240862a3c3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:06.674811 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7172c534-2d99-4497-a2f0-fa240862a3c3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:06.675282 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7172c534-2d99-4497-a2f0-fa240862a3c3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:06.675734 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7172c534-2d99-4497-a2f0-fa240862a3c3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:06.676467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7172c534-2d99-4497-a2f0-fa240862a3c3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:06.676915 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7172c534-2d99-4497-a2f0-fa240862a3c3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:06.677380 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7172c534-2d99-4497-a2f0-fa240862a3c3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:06.921436 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7172c534-2d99-4497-a2f0-fa240862a3c3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:06.932397 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7172c534-2d99-4497-a2f0-fa240862a3c3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:06.934235 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7172c534-2d99-4497-a2f0-fa240862a3c3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:06.935717 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7172c534-2d99-4497-a2f0-fa240862a3c3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1725 microversion: 2.20 time: 0.276682 Aug 19 16:35:06.937072 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 242/493] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:06 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1725 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:06.971523 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-004de691-f813-4636-b36c-d14a65a5718e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e623f028-5c06-4497-ae3e-f5cd6169d256"}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:35:06.975178 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-004de691-f813-4636-b36c-d14a65a5718e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:06.985407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-004de691-f813-4636-b36c-d14a65a5718e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:06.988321 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-004de691-f813-4636-b36c-d14a65a5718e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:06.989862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-004de691-f813-4636-b36c-d14a65a5718e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:06.990947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-004de691-f813-4636-b36c-d14a65a5718e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:06.991632 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-004de691-f813-4636-b36c-d14a65a5718e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:06.992323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-004de691-f813-4636-b36c-d14a65a5718e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:07.296002 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-4e07248f-76a1-4070-9b6d-539b8335d41e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:07.296697 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-4e07248f-76a1-4070-9b6d-539b8335d41e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:07.300505 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=54 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:35:07.313878 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4e07248f-76a1-4070-9b6d-539b8335d41e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:07.315146 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4e07248f-76a1-4070-9b6d-539b8335d41e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:07.317043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4e07248f-76a1-4070-9b6d-539b8335d41e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:07.318704 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4e07248f-76a1-4070-9b6d-539b8335d41e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:07.320232 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4e07248f-76a1-4070-9b6d-539b8335d41e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:07.320885 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4e07248f-76a1-4070-9b6d-539b8335d41e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:07.528325 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-004de691-f813-4636-b36c-d14a65a5718e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "POST /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.572367 Aug 19 16:35:07.529593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 252/494] 10.222.0.55 () {62 vars in 1364 bytes} [Fri Aug 19 16:35:06 2022] POST /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8/os-volume_attachments => generated 188 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:35:07.540565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8db0d533-2157-4337-8acb-fcdfebd96eac tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:07.542368 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8db0d533-2157-4337-8acb-fcdfebd96eac tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:07.549330 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8db0d533-2157-4337-8acb-fcdfebd96eac tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:07.549837 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8db0d533-2157-4337-8acb-fcdfebd96eac tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:07.550279 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8db0d533-2157-4337-8acb-fcdfebd96eac tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:07.552443 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8db0d533-2157-4337-8acb-fcdfebd96eac tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:07.552957 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8db0d533-2157-4337-8acb-fcdfebd96eac tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:07.553398 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8db0d533-2157-4337-8acb-fcdfebd96eac tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:07.609313 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8db0d533-2157-4337-8acb-fcdfebd96eac tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Going to try to terminate instance {{(pid=127285) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:35:07.680789 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-4e07248f-76a1-4070-9b6d-539b8335d41e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:07.683792 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-4e07248f-76a1-4070-9b6d-539b8335d41e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.394939 Aug 19 16:35:07.694892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 243/495] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:07 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:07.701042 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f89ec079-803f-4082-bc76-edc810dd39e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:35:07.701630 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f89ec079-803f-4082-bc76-edc810dd39e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:07.711857 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f89ec079-803f-4082-bc76-edc810dd39e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:07.718277 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f89ec079-803f-4082-bc76-edc810dd39e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:07.718876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f89ec079-803f-4082-bc76-edc810dd39e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:07.719820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f89ec079-803f-4082-bc76-edc810dd39e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:07.720395 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f89ec079-803f-4082-bc76-edc810dd39e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:07.724515 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f89ec079-803f-4082-bc76-edc810dd39e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:07.738409 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8db0d533-2157-4337-8acb-fcdfebd96eac tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "DELETE /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 204 len: 0 microversion: 2.1 time: 0.207180 Aug 19 16:35:07.743110 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 253/496] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:35:07 2022] DELETE /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:35:07.753622 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ac503fda-3498-4ebe-a5dd-ff99ae54f114 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:07.754612 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ac503fda-3498-4ebe-a5dd-ff99ae54f114 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:07.765309 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ac503fda-3498-4ebe-a5dd-ff99ae54f114 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:07.765309 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ac503fda-3498-4ebe-a5dd-ff99ae54f114 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:07.765696 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ac503fda-3498-4ebe-a5dd-ff99ae54f114 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:07.766385 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ac503fda-3498-4ebe-a5dd-ff99ae54f114 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:07.766886 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ac503fda-3498-4ebe-a5dd-ff99ae54f114 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:07.767456 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ac503fda-3498-4ebe-a5dd-ff99ae54f114 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:07.827825 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f89ec079-803f-4082-bc76-edc810dd39e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127284) unshelve /opt/stack/nova/nova/compute/api.py:4584}} Aug 19 16:35:07.972031 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f89ec079-803f-4082-bc76-edc810dd39e2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "POST /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8/action" status: 202 len: 0 microversion: 2.20 time: 0.275894 Aug 19 16:35:07.973264 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 244/497] 10.222.0.55 () {62 vars in 1319 bytes} [Fri Aug 19 16:35:07 2022] POST /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:35:07.986123 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e21f6991-3e8d-44a9-928b-f659eb301565 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:07.987842 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-e21f6991-3e8d-44a9-928b-f659eb301565 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:07.998845 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ac503fda-3498-4ebe-a5dd-ff99ae54f114 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:08.003428 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e21f6991-3e8d-44a9-928b-f659eb301565 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:08.003926 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e21f6991-3e8d-44a9-928b-f659eb301565 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:08.004557 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e21f6991-3e8d-44a9-928b-f659eb301565 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:08.006275 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e21f6991-3e8d-44a9-928b-f659eb301565 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:08.006951 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e21f6991-3e8d-44a9-928b-f659eb301565 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:08.007550 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e21f6991-3e8d-44a9-928b-f659eb301565 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:08.008185 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ac503fda-3498-4ebe-a5dd-ff99ae54f114 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1515 microversion: 2.1 time: 0.263225 Aug 19 16:35:08.021311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 254/498] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:07 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1515 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:08.241696 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e21f6991-3e8d-44a9-928b-f659eb301565 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:08.252436 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e21f6991-3e8d-44a9-928b-f659eb301565 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:08.254868 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e21f6991-3e8d-44a9-928b-f659eb301565 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:08.256813 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e21f6991-3e8d-44a9-928b-f659eb301565 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1751 microversion: 2.20 time: 0.279115 Aug 19 16:35:08.274723 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 245/499] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:07 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1751 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:08.716787 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b6a4c21b-c2e6-45fc-a7ab-b6c7ae28dd11 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:08.717425 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b6a4c21b-c2e6-45fc-a7ab-b6c7ae28dd11 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:08.727732 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b6a4c21b-c2e6-45fc-a7ab-b6c7ae28dd11 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:08.731086 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b6a4c21b-c2e6-45fc-a7ab-b6c7ae28dd11 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:08.731698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b6a4c21b-c2e6-45fc-a7ab-b6c7ae28dd11 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:08.732767 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b6a4c21b-c2e6-45fc-a7ab-b6c7ae28dd11 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:08.734875 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b6a4c21b-c2e6-45fc-a7ab-b6c7ae28dd11 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:08.735471 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b6a4c21b-c2e6-45fc-a7ab-b6c7ae28dd11 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:08.961697 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b6a4c21b-c2e6-45fc-a7ab-b6c7ae28dd11 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:08.971397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b6a4c21b-c2e6-45fc-a7ab-b6c7ae28dd11 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.259565 Aug 19 16:35:08.981620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 255/500] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:08 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:09.033517 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-3d505980-5e86-4f0a-a628-59ce0e6bca29 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:09.034244 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-3d505980-5e86-4f0a-a628-59ce0e6bca29 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:09.043735 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3d505980-5e86-4f0a-a628-59ce0e6bca29 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:09.044279 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3d505980-5e86-4f0a-a628-59ce0e6bca29 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:09.044716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3d505980-5e86-4f0a-a628-59ce0e6bca29 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:09.045444 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3d505980-5e86-4f0a-a628-59ce0e6bca29 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:09.045953 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3d505980-5e86-4f0a-a628-59ce0e6bca29 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:09.046400 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3d505980-5e86-4f0a-a628-59ce0e6bca29 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:09.276690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-3d505980-5e86-4f0a-a628-59ce0e6bca29 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:09.279285 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a67ce047-0d4f-41ed-a7f9-b2764927088f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:09.279908 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a67ce047-0d4f-41ed-a7f9-b2764927088f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:09.290831 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a67ce047-0d4f-41ed-a7f9-b2764927088f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:09.291660 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a67ce047-0d4f-41ed-a7f9-b2764927088f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:09.292296 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-3d505980-5e86-4f0a-a628-59ce0e6bca29 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1515 microversion: 2.1 time: 0.264908 Aug 19 16:35:09.292617 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a67ce047-0d4f-41ed-a7f9-b2764927088f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:09.293065 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 246/501] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:09 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1515 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:09.294638 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a67ce047-0d4f-41ed-a7f9-b2764927088f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:09.295464 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a67ce047-0d4f-41ed-a7f9-b2764927088f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:09.296346 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a67ce047-0d4f-41ed-a7f9-b2764927088f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:09.542923 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a67ce047-0d4f-41ed-a7f9-b2764927088f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:09.553320 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a67ce047-0d4f-41ed-a7f9-b2764927088f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:09.554813 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a67ce047-0d4f-41ed-a7f9-b2764927088f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:09.556144 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a67ce047-0d4f-41ed-a7f9-b2764927088f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1751 microversion: 2.20 time: 0.280709 Aug 19 16:35:09.557218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 256/502] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:09 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1751 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:35:09.993893 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-5a6ed928-fd7a-4509-8320-358b4283dd27 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:09.994622 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-5a6ed928-fd7a-4509-8320-358b4283dd27 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:10.000576 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5a6ed928-fd7a-4509-8320-358b4283dd27 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:10.001178 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5a6ed928-fd7a-4509-8320-358b4283dd27 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:10.001697 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5a6ed928-fd7a-4509-8320-358b4283dd27 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:10.002473 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5a6ed928-fd7a-4509-8320-358b4283dd27 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:10.003008 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5a6ed928-fd7a-4509-8320-358b4283dd27 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:10.003512 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5a6ed928-fd7a-4509-8320-358b4283dd27 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:10.164340 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-5a6ed928-fd7a-4509-8320-358b4283dd27 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:10.174558 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-5a6ed928-fd7a-4509-8320-358b4283dd27 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.185561 Aug 19 16:35:10.175646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 247/503] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:09 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:10.314949 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-cd313cc5-67bb-4550-8122-9ea841ac6af3 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:10.315693 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-cd313cc5-67bb-4550-8122-9ea841ac6af3 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:10.318992 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:35:10.326567 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cd313cc5-67bb-4550-8122-9ea841ac6af3 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:10.327145 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cd313cc5-67bb-4550-8122-9ea841ac6af3 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:10.327594 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cd313cc5-67bb-4550-8122-9ea841ac6af3 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:10.328306 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cd313cc5-67bb-4550-8122-9ea841ac6af3 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:10.329047 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cd313cc5-67bb-4550-8122-9ea841ac6af3 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:10.329484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cd313cc5-67bb-4550-8122-9ea841ac6af3 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:10.528060 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-cd313cc5-67bb-4550-8122-9ea841ac6af3 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:10.536901 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-cd313cc5-67bb-4550-8122-9ea841ac6af3 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1515 microversion: 2.1 time: 0.227143 Aug 19 16:35:10.537482 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 257/504] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:10 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1515 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:10.586508 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-710b21cf-a390-4d18-a349-6eeeae34d1d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:10.587421 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-710b21cf-a390-4d18-a349-6eeeae34d1d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:10.595430 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-710b21cf-a390-4d18-a349-6eeeae34d1d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:10.599379 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-710b21cf-a390-4d18-a349-6eeeae34d1d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:10.612192 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-710b21cf-a390-4d18-a349-6eeeae34d1d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:10.613349 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-710b21cf-a390-4d18-a349-6eeeae34d1d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:10.614672 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-710b21cf-a390-4d18-a349-6eeeae34d1d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:10.619615 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-710b21cf-a390-4d18-a349-6eeeae34d1d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:10.829432 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-710b21cf-a390-4d18-a349-6eeeae34d1d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:10.840301 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-710b21cf-a390-4d18-a349-6eeeae34d1d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:10.842073 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-710b21cf-a390-4d18-a349-6eeeae34d1d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:10.843410 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-710b21cf-a390-4d18-a349-6eeeae34d1d7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1753 microversion: 2.20 time: 0.266126 Aug 19 16:35:10.844112 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 248/505] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:10 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1753 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:11.199987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-beddaf64-74d6-45e3-9659-8bef67a1b40d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:11.201173 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-beddaf64-74d6-45e3-9659-8bef67a1b40d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:11.208414 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-beddaf64-74d6-45e3-9659-8bef67a1b40d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:11.209198 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-beddaf64-74d6-45e3-9659-8bef67a1b40d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:11.209854 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-beddaf64-74d6-45e3-9659-8bef67a1b40d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:11.210704 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-beddaf64-74d6-45e3-9659-8bef67a1b40d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:11.211300 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-beddaf64-74d6-45e3-9659-8bef67a1b40d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:11.212305 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-beddaf64-74d6-45e3-9659-8bef67a1b40d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:11.561957 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-3170d2bf-cf10-4cae-8d6a-d665aa2a2865 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:11.563190 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-3170d2bf-cf10-4cae-8d6a-d665aa2a2865 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:11.578285 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3170d2bf-cf10-4cae-8d6a-d665aa2a2865 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:11.579423 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3170d2bf-cf10-4cae-8d6a-d665aa2a2865 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:11.580091 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3170d2bf-cf10-4cae-8d6a-d665aa2a2865 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:11.581545 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3170d2bf-cf10-4cae-8d6a-d665aa2a2865 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:11.582280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3170d2bf-cf10-4cae-8d6a-d665aa2a2865 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:11.583450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3170d2bf-cf10-4cae-8d6a-d665aa2a2865 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:11.736670 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-beddaf64-74d6-45e3-9659-8bef67a1b40d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:11.759686 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-beddaf64-74d6-45e3-9659-8bef67a1b40d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.565403 Aug 19 16:35:11.761264 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 258/506] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:11 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:11.831902 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-3170d2bf-cf10-4cae-8d6a-d665aa2a2865 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:11.843559 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-3170d2bf-cf10-4cae-8d6a-d665aa2a2865 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1515 microversion: 2.1 time: 0.286039 Aug 19 16:35:11.845964 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 249/507] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:11 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1515 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:11.868349 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4367b403-653b-4781-93ed-fe360f20df89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:11.868997 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-4367b403-653b-4781-93ed-fe360f20df89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:11.875334 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4367b403-653b-4781-93ed-fe360f20df89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:11.875855 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4367b403-653b-4781-93ed-fe360f20df89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:11.876473 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4367b403-653b-4781-93ed-fe360f20df89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:11.877492 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4367b403-653b-4781-93ed-fe360f20df89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:11.878111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4367b403-653b-4781-93ed-fe360f20df89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:11.878550 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4367b403-653b-4781-93ed-fe360f20df89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:12.145884 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-46801a9f-5431-436d-94cd-5910b929975c req-b7666dc3-0763-4103-968c-933cefba1920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38a84b78-4b40-4cfe-b649-528c7dad0f32", "name": "network-vif-deleted", "tag": "78290210-89a1-48d0-a016-f3d5096766a8"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:35:12.158185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-46801a9f-5431-436d-94cd-5910b929975c req-b7666dc3-0763-4103-968c-933cefba1920 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:12.158671 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-46801a9f-5431-436d-94cd-5910b929975c req-b7666dc3-0763-4103-968c-933cefba1920 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:12.159165 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-46801a9f-5431-436d-94cd-5910b929975c req-b7666dc3-0763-4103-968c-933cefba1920 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:12.160655 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-4367b403-653b-4781-93ed-fe360f20df89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:12.173338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-4367b403-653b-4781-93ed-fe360f20df89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:12.178373 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-4367b403-653b-4781-93ed-fe360f20df89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:12.179204 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-46801a9f-5431-436d-94cd-5910b929975c req-b7666dc3-0763-4103-968c-933cefba1920 service nova] Creating event network-vif-deleted:78290210-89a1-48d0-a016-f3d5096766a8 for instance 38a84b78-4b40-4cfe-b649-528c7dad0f32 on hv-cinder-83124 Aug 19 16:35:12.180086 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4367b403-653b-4781-93ed-fe360f20df89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1753 microversion: 2.20 time: 0.316802 Aug 19 16:35:12.181169 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 259/508] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:11 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1753 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:12.185106 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-46801a9f-5431-436d-94cd-5910b929975c req-b7666dc3-0763-4103-968c-933cefba1920 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043085 Aug 19 16:35:12.186006 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 250/509] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:35:12.784188 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ee456def-9a7e-4dc9-8789-9f2ddb357701 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:12.784829 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ee456def-9a7e-4dc9-8789-9f2ddb357701 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:12.806999 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ee456def-9a7e-4dc9-8789-9f2ddb357701 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:12.807521 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ee456def-9a7e-4dc9-8789-9f2ddb357701 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:12.807984 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ee456def-9a7e-4dc9-8789-9f2ddb357701 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:12.808687 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ee456def-9a7e-4dc9-8789-9f2ddb357701 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:12.809163 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ee456def-9a7e-4dc9-8789-9f2ddb357701 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:12.809580 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ee456def-9a7e-4dc9-8789-9f2ddb357701 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:12.871238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e50c154c-7778-498b-8ab6-1db5e1ef1903 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:12.872600 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-e50c154c-7778-498b-8ab6-1db5e1ef1903 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:12.885680 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e50c154c-7778-498b-8ab6-1db5e1ef1903 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:12.891027 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e50c154c-7778-498b-8ab6-1db5e1ef1903 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:12.891702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e50c154c-7778-498b-8ab6-1db5e1ef1903 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:12.892611 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e50c154c-7778-498b-8ab6-1db5e1ef1903 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:12.896050 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e50c154c-7778-498b-8ab6-1db5e1ef1903 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:12.896702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e50c154c-7778-498b-8ab6-1db5e1ef1903 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:12.941793 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e50c154c-7778-498b-8ab6-1db5e1ef1903 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:12.942778 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e50c154c-7778-498b-8ab6-1db5e1ef1903 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:12.943479 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e50c154c-7778-498b-8ab6-1db5e1ef1903 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:12.944128 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.objects.instance [None req-e50c154c-7778-498b-8ab6-1db5e1ef1903 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lazy-loading 'fault' on Instance uuid 38a84b78-4b40-4cfe-b649-528c7dad0f32 {{(pid=127284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:35:12.990751 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e50c154c-7778-498b-8ab6-1db5e1ef1903 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:13.002909 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e50c154c-7778-498b-8ab6-1db5e1ef1903 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 200 len: 1309 microversion: 2.1 time: 0.138999 Aug 19 16:35:13.004457 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 251/510] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:12 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 1309 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:13.106110 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ee456def-9a7e-4dc9-8789-9f2ddb357701 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:13.120063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ee456def-9a7e-4dc9-8789-9f2ddb357701 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.341471 Aug 19 16:35:13.121949 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 260/511] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:12 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:13.243500 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7d401297-758e-438f-bcb5-04a87d59ae1d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:13.243500 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7d401297-758e-438f-bcb5-04a87d59ae1d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:13.269598 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7d401297-758e-438f-bcb5-04a87d59ae1d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:13.275889 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7d401297-758e-438f-bcb5-04a87d59ae1d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:13.277369 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7d401297-758e-438f-bcb5-04a87d59ae1d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:13.278706 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7d401297-758e-438f-bcb5-04a87d59ae1d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:13.284896 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7d401297-758e-438f-bcb5-04a87d59ae1d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:13.286373 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7d401297-758e-438f-bcb5-04a87d59ae1d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:13.478840 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7d401297-758e-438f-bcb5-04a87d59ae1d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:13.494175 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7d401297-758e-438f-bcb5-04a87d59ae1d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:13.496496 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7d401297-758e-438f-bcb5-04a87d59ae1d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:13.498314 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7d401297-758e-438f-bcb5-04a87d59ae1d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.280427 Aug 19 16:35:13.506059 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 252/512] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:13 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:14.027466 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-9c2511ac-e794-430d-a4e5-0eae8bd8991a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:14.029044 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-9c2511ac-e794-430d-a4e5-0eae8bd8991a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: 38a84b78-4b40-4cfe-b649-528c7dad0f32] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:14.036348 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9c2511ac-e794-430d-a4e5-0eae8bd8991a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:14.037193 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9c2511ac-e794-430d-a4e5-0eae8bd8991a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:14.037865 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9c2511ac-e794-430d-a4e5-0eae8bd8991a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:14.039622 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9c2511ac-e794-430d-a4e5-0eae8bd8991a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:14.040307 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9c2511ac-e794-430d-a4e5-0eae8bd8991a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:14.041154 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9c2511ac-e794-430d-a4e5-0eae8bd8991a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:14.062919 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-9c2511ac-e794-430d-a4e5-0eae8bd8991a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] HTTP exception thrown: Instance 38a84b78-4b40-4cfe-b649-528c7dad0f32 could not be found. Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-9c2511ac-e794-430d-a4e5-0eae8bd8991a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Request method failure captured: Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 HTTP/1.1 Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7tcgDhydjzidOk7JI8tHrZyBWnFIV30qL53peDuFgzOVZ1ksAnkCW8WGNalZB94fAj93b2aIfqfYYE0IH6vRDjZl1s2iEzs1wgMEYY5XyoRjoDG08YsLBtRP8j6UDUltk7gbxHKDBD0uhJdpHRBDKm5GCKP-lSMhBr4WQrRPf8Po50 Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: b34c07333ddf4a19b35424d47d19dc60 Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1052536023 Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:35:14.065323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:35:14.066613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b34c07333ddf4a19b35424d47d19dc60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b34c07333ddf4a19b35424d47d19dc60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b34c07333ddf4a19b35424d47d19dc60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b34c07333ddf4a19b35424d47d19dc60"}]}] Aug 19 16:35:14.066613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-VolumesSnapshotTestJSON-1052536023 Aug 19 16:35:14.066613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: b34c07333ddf4a19b35424d47d19dc60 Aug 19 16:35:14.066613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1052536023 Aug 19 16:35:14.066613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-VolumesSnapshotTestJSON-1052536023-project Aug 19 16:35:14.066613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:35:14.066613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:35:14.066613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: d9e505bb350e4134976000a83bdd4fe1 Aug 19 16:35:14.066613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-VolumesSnapshotTestJSON-1052536023-project Aug 19 16:35:14.066613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:35:14.066613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance 38a84b78-4b40-4cfe-b649-528c7dad0f32 could not be found. Aug 19 16:35:14.066613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': '38a84b78-4b40-4cfe-b649-528c7dad0f32'} Aug 19 16:35:14.067421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:35:14.067421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:35:14.067421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:35:14.067421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:35:14.067421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:35:14.067421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:35:14.067421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:35:14.067421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:35:14.067421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:35:14.067421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:35:14.067421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38a84b78-4b40-4cfe-b649-528c7dad0f32 could not be found. Aug 19 16:35:14.067421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:35:14.067421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:35:14.067421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:35:14.067421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:35:14.067421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:35:14.067421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:35:14.067421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:35:14.067421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:35:14.067421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:35:14.068552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:35:14.068552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:35:14.068552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:35:14.068552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:35:14.068552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:35:14.068552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:35:14.068552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:35:14.068552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38a84b78-4b40-4cfe-b649-528c7dad0f32 could not be found. Aug 19 16:35:14.068552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:35:14.068552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:35:14.068552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:35:14.068552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:35:14.068552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:35:14.068552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:35:14.068552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:35:14.068552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:35:14.068552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38a84b78-4b40-4cfe-b649-528c7dad0f32 could not be found. Aug 19 16:35:14.068552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:35:14.071616 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-9c2511ac-e794-430d-a4e5-0eae8bd8991a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Returning 404 to user: Instance 38a84b78-4b40-4cfe-b649-528c7dad0f32 could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:35:14.072834 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-9c2511ac-e794-430d-a4e5-0eae8bd8991a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32" status: 404 len: 111 microversion: 2.1 time: 0.051272 Aug 19 16:35:14.077538 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 261/513] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:14 2022] GET /compute/v2.1/servers/38a84b78-4b40-4cfe-b649-528c7dad0f32 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:35:14.145574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7bf87410-3b6b-4ca5-858d-4e9e85901d6b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:14.146430 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7bf87410-3b6b-4ca5-858d-4e9e85901d6b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:14.169003 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7bf87410-3b6b-4ca5-858d-4e9e85901d6b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:14.169595 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7bf87410-3b6b-4ca5-858d-4e9e85901d6b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:14.170049 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7bf87410-3b6b-4ca5-858d-4e9e85901d6b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:14.173213 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7bf87410-3b6b-4ca5-858d-4e9e85901d6b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:14.173729 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7bf87410-3b6b-4ca5-858d-4e9e85901d6b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:14.177246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7bf87410-3b6b-4ca5-858d-4e9e85901d6b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:14.424110 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7bf87410-3b6b-4ca5-858d-4e9e85901d6b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:14.434043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7bf87410-3b6b-4ca5-858d-4e9e85901d6b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.295039 Aug 19 16:35:14.434605 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 253/514] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:14 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:14.523326 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f1a2baf7-5d83-4ba3-932b-1712436270d9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:14.524116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f1a2baf7-5d83-4ba3-932b-1712436270d9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:14.530595 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f1a2baf7-5d83-4ba3-932b-1712436270d9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:14.531327 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f1a2baf7-5d83-4ba3-932b-1712436270d9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:14.531925 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f1a2baf7-5d83-4ba3-932b-1712436270d9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:14.532825 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f1a2baf7-5d83-4ba3-932b-1712436270d9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:14.533281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f1a2baf7-5d83-4ba3-932b-1712436270d9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:14.533747 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f1a2baf7-5d83-4ba3-932b-1712436270d9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:14.730220 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f1a2baf7-5d83-4ba3-932b-1712436270d9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:14.740643 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f1a2baf7-5d83-4ba3-932b-1712436270d9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:14.742177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f1a2baf7-5d83-4ba3-932b-1712436270d9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:14.744218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f1a2baf7-5d83-4ba3-932b-1712436270d9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.225754 Aug 19 16:35:14.744781 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 262/515] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:14 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:15.456007 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-faf3b230-f657-48a8-9e7c-f7db012305be tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:15.458684 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-faf3b230-f657-48a8-9e7c-f7db012305be tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:15.472446 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-faf3b230-f657-48a8-9e7c-f7db012305be tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:15.473874 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-faf3b230-f657-48a8-9e7c-f7db012305be tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:15.474413 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-faf3b230-f657-48a8-9e7c-f7db012305be tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:15.475535 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-faf3b230-f657-48a8-9e7c-f7db012305be tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:15.476177 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-faf3b230-f657-48a8-9e7c-f7db012305be tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:15.476313 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-faf3b230-f657-48a8-9e7c-f7db012305be tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:15.637720 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-faf3b230-f657-48a8-9e7c-f7db012305be tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:15.663467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-faf3b230-f657-48a8-9e7c-f7db012305be tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.211506 Aug 19 16:35:15.664917 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 254/516] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:15 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:15.767217 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d2e84d50-c32f-4853-8801-0f627bd138d2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:15.768465 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d2e84d50-c32f-4853-8801-0f627bd138d2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:15.778204 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2e84d50-c32f-4853-8801-0f627bd138d2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:15.778712 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2e84d50-c32f-4853-8801-0f627bd138d2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:15.779153 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2e84d50-c32f-4853-8801-0f627bd138d2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:15.779867 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2e84d50-c32f-4853-8801-0f627bd138d2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:15.780316 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2e84d50-c32f-4853-8801-0f627bd138d2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:15.781015 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2e84d50-c32f-4853-8801-0f627bd138d2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:15.785615 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:35:15.965792 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d2e84d50-c32f-4853-8801-0f627bd138d2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:15.975240 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d2e84d50-c32f-4853-8801-0f627bd138d2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:15.984788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d2e84d50-c32f-4853-8801-0f627bd138d2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:15.986255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d2e84d50-c32f-4853-8801-0f627bd138d2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.223213 Aug 19 16:35:16.000887 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 263/517] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:15 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:35:16.686197 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-96044e63-8a62-43ae-8a88-9ead4cba0f18 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:16.687640 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-96044e63-8a62-43ae-8a88-9ead4cba0f18 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:16.694688 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-96044e63-8a62-43ae-8a88-9ead4cba0f18 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:16.695175 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-96044e63-8a62-43ae-8a88-9ead4cba0f18 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:16.695688 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-96044e63-8a62-43ae-8a88-9ead4cba0f18 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:16.696377 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-96044e63-8a62-43ae-8a88-9ead4cba0f18 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:16.696850 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-96044e63-8a62-43ae-8a88-9ead4cba0f18 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:16.697445 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-96044e63-8a62-43ae-8a88-9ead4cba0f18 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:16.933826 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-96044e63-8a62-43ae-8a88-9ead4cba0f18 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:16.944188 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-96044e63-8a62-43ae-8a88-9ead4cba0f18 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.262302 Aug 19 16:35:16.954368 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 255/518] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:16 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:17.013651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-146cc0f7-e736-4f42-b1c2-44c87d2ae9c7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:17.014948 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-146cc0f7-e736-4f42-b1c2-44c87d2ae9c7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:17.022457 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-146cc0f7-e736-4f42-b1c2-44c87d2ae9c7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:17.022928 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-146cc0f7-e736-4f42-b1c2-44c87d2ae9c7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:17.023357 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-146cc0f7-e736-4f42-b1c2-44c87d2ae9c7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:17.024317 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-146cc0f7-e736-4f42-b1c2-44c87d2ae9c7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:17.024969 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-146cc0f7-e736-4f42-b1c2-44c87d2ae9c7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:17.025542 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-146cc0f7-e736-4f42-b1c2-44c87d2ae9c7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:17.326315 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-146cc0f7-e736-4f42-b1c2-44c87d2ae9c7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:17.336904 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-146cc0f7-e736-4f42-b1c2-44c87d2ae9c7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:17.338502 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-146cc0f7-e736-4f42-b1c2-44c87d2ae9c7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:17.339689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-146cc0f7-e736-4f42-b1c2-44c87d2ae9c7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.330107 Aug 19 16:35:17.340580 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 264/519] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:17 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:35:17.968022 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-fdbcdf29-879f-4706-b2fe-8b0d3265d264 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:17.969350 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-fdbcdf29-879f-4706-b2fe-8b0d3265d264 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:17.977458 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fdbcdf29-879f-4706-b2fe-8b0d3265d264 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:17.978442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fdbcdf29-879f-4706-b2fe-8b0d3265d264 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:17.979214 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fdbcdf29-879f-4706-b2fe-8b0d3265d264 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:17.980231 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fdbcdf29-879f-4706-b2fe-8b0d3265d264 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:17.981061 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fdbcdf29-879f-4706-b2fe-8b0d3265d264 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:17.981800 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fdbcdf29-879f-4706-b2fe-8b0d3265d264 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:18.005783 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:35:18.143919 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-fdbcdf29-879f-4706-b2fe-8b0d3265d264 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:18.153405 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-fdbcdf29-879f-4706-b2fe-8b0d3265d264 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.189926 Aug 19 16:35:18.154073 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 256/520] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:17 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:18.367916 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-fd974cfc-b95d-433e-bc93-76b1ca063486 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:18.372649 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-fd974cfc-b95d-433e-bc93-76b1ca063486 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:18.381400 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fd974cfc-b95d-433e-bc93-76b1ca063486 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:18.381980 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fd974cfc-b95d-433e-bc93-76b1ca063486 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:18.382480 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fd974cfc-b95d-433e-bc93-76b1ca063486 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:18.393858 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fd974cfc-b95d-433e-bc93-76b1ca063486 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:18.394755 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fd974cfc-b95d-433e-bc93-76b1ca063486 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:18.395751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fd974cfc-b95d-433e-bc93-76b1ca063486 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:18.638128 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fd974cfc-b95d-433e-bc93-76b1ca063486 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:18.672912 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fd974cfc-b95d-433e-bc93-76b1ca063486 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:18.683504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fd974cfc-b95d-433e-bc93-76b1ca063486 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:18.694153 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-fd974cfc-b95d-433e-bc93-76b1ca063486 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.327489 Aug 19 16:35:18.708566 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 265/521] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:18 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:19.177316 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c2130aba-8aa5-4fb9-aff1-3991c70cc11e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:19.178597 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-c2130aba-8aa5-4fb9-aff1-3991c70cc11e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:19.189095 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c2130aba-8aa5-4fb9-aff1-3991c70cc11e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:19.191189 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c2130aba-8aa5-4fb9-aff1-3991c70cc11e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:19.193301 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c2130aba-8aa5-4fb9-aff1-3991c70cc11e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:19.194287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c2130aba-8aa5-4fb9-aff1-3991c70cc11e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:19.281410 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c2130aba-8aa5-4fb9-aff1-3991c70cc11e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:19.281410 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c2130aba-8aa5-4fb9-aff1-3991c70cc11e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:19.562081 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c2130aba-8aa5-4fb9-aff1-3991c70cc11e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:19.572459 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c2130aba-8aa5-4fb9-aff1-3991c70cc11e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.400844 Aug 19 16:35:19.573611 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 257/522] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:19 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:19.731325 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-dbf20631-4fb3-4abe-8832-0ab9c7f041ef tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:19.733362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-dbf20631-4fb3-4abe-8832-0ab9c7f041ef tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:19.748592 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dbf20631-4fb3-4abe-8832-0ab9c7f041ef tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:19.749387 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dbf20631-4fb3-4abe-8832-0ab9c7f041ef tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:19.749994 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dbf20631-4fb3-4abe-8832-0ab9c7f041ef tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:19.750893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dbf20631-4fb3-4abe-8832-0ab9c7f041ef tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:19.751506 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dbf20631-4fb3-4abe-8832-0ab9c7f041ef tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:19.752090 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dbf20631-4fb3-4abe-8832-0ab9c7f041ef tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:19.955950 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-dbf20631-4fb3-4abe-8832-0ab9c7f041ef tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:19.967574 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-dbf20631-4fb3-4abe-8832-0ab9c7f041ef tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:19.969548 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-dbf20631-4fb3-4abe-8832-0ab9c7f041ef tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:19.971598 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-dbf20631-4fb3-4abe-8832-0ab9c7f041ef tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.254185 Aug 19 16:35:19.972632 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 266/523] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:19 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:20.606042 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7a781223-2049-464c-90d3-c398c82941e9 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:20.606659 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7a781223-2049-464c-90d3-c398c82941e9 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:20.619212 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7a781223-2049-464c-90d3-c398c82941e9 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:20.624962 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7a781223-2049-464c-90d3-c398c82941e9 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:20.625592 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7a781223-2049-464c-90d3-c398c82941e9 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:20.626491 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7a781223-2049-464c-90d3-c398c82941e9 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:20.626948 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7a781223-2049-464c-90d3-c398c82941e9 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:20.627375 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7a781223-2049-464c-90d3-c398c82941e9 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:20.811350 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7a781223-2049-464c-90d3-c398c82941e9 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:20.820623 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7a781223-2049-464c-90d3-c398c82941e9 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.229019 Aug 19 16:35:20.821235 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 258/524] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:20 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:20.921688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-7bac6cb3-a737-48cc-a0f7-075689d2e695 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Action: 'create', calling method: .version_select at 0x7fb01e057040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-653141891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESAR7UhkbZoPoWHSxGBUntE2eDWluJuJbPtZVQSzJMpEh+oGc1l5xCPRlc1O7wyz0sUfsfkKBd2QrmDY3yeUIcyt+KGjoBj+d76MZ+cFq5jZ/OBDxfLpgaaRbetttcqVg=="}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:35:20.938261 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-7bac6cb3-a737-48cc-a0f7-075689d2e695 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Getting quotas for project a41afd08d1324396940e3acaf49a34b3. Resources: {'key_pairs'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:35:20.942410 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-7bac6cb3-a737-48cc-a0f7-075689d2e695 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Getting quotas for user cf1371337c03435faa5f1db60168cfbe and project a41afd08d1324396940e3acaf49a34b3. Resources: {'key_pairs'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:35:20.965299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-7bac6cb3-a737-48cc-a0f7-075689d2e695 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.047304 Aug 19 16:35:20.965895 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 267/525] 10.222.0.55 () {60 vars in 1159 bytes} [Fri Aug 19 16:35:20 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:35:21.000490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-35de9069-e0b2-4735-ad90-caf7732fbe57 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:21.001681 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-35de9069-e0b2-4735-ad90-caf7732fbe57 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:21.009062 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35de9069-e0b2-4735-ad90-caf7732fbe57 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:21.009662 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35de9069-e0b2-4735-ad90-caf7732fbe57 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:21.010194 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35de9069-e0b2-4735-ad90-caf7732fbe57 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:21.011001 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35de9069-e0b2-4735-ad90-caf7732fbe57 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:21.011561 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35de9069-e0b2-4735-ad90-caf7732fbe57 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:21.012066 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35de9069-e0b2-4735-ad90-caf7732fbe57 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:21.021625 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6e722ac1-d991-47e1-8b34-093b65482b22 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2126989938", "imageRef": "9380ba06-d49d-488f-9061-c37fe6038835", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-653141891", "networks": [{"uuid": "a2f71928-2ab4-4f84-8637-2465e10526ac"}]}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:35:21.080170 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.network.neutron [None req-6e722ac1-d991-47e1-8b34-093b65482b22 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] validate_networks() for [('a2f71928-2ab4-4f84-8637-2465e10526ac', None, None, None, None, None)] {{(pid=127285) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:35:21.184036 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-35de9069-e0b2-4735-ad90-caf7732fbe57 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:21.194625 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-35de9069-e0b2-4735-ad90-caf7732fbe57 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:21.196116 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-35de9069-e0b2-4735-ad90-caf7732fbe57 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:21.197562 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-35de9069-e0b2-4735-ad90-caf7732fbe57 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.201817 Aug 19 16:35:21.198118 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 259/526] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:20 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:21.502555 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-6e722ac1-d991-47e1-8b34-093b65482b22 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Flavor limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:35:21.503010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-6e722ac1-d991-47e1-8b34-093b65482b22 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Image limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:35:21.503506 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-6e722ac1-d991-47e1-8b34-093b65482b22 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Flavor pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:35:21.504558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-6e722ac1-d991-47e1-8b34-093b65482b22 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Image pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:35:21.505009 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-6e722ac1-d991-47e1-8b34-093b65482b22 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:35:21.513627 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e722ac1-d991-47e1-8b34-093b65482b22 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:21.514098 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e722ac1-d991-47e1-8b34-093b65482b22 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:21.514528 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e722ac1-d991-47e1-8b34-093b65482b22 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:21.515245 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e722ac1-d991-47e1-8b34-093b65482b22 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:21.515697 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e722ac1-d991-47e1-8b34-093b65482b22 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:21.516120 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e722ac1-d991-47e1-8b34-093b65482b22 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:21.532725 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-6e722ac1-d991-47e1-8b34-093b65482b22 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Getting quotas for project a41afd08d1324396940e3acaf49a34b3. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:35:21.537404 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-6e722ac1-d991-47e1-8b34-093b65482b22 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Getting quotas for user cf1371337c03435faa5f1db60168cfbe and project a41afd08d1324396940e3acaf49a34b3. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:35:21.548799 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6e722ac1-d991-47e1-8b34-093b65482b22 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Going to run 1 instances... {{(pid=127285) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:35:21.551619 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6e722ac1-d991-47e1-8b34-093b65482b22 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9380ba06-d49d-488f-9061-c37fe6038835',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127285) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:35:21.595151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6e722ac1-d991-47e1-8b34-093b65482b22 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577680 Aug 19 16:35:21.596096 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 268/527] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Aug 19 16:35:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 19 16:35:21.607328 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-45be74af-0967-4106-85d7-793e56074bf6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:21.608195 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-45be74af-0967-4106-85d7-793e56074bf6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:21.667884 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-45be74af-0967-4106-85d7-793e56074bf6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:21.675106 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-45be74af-0967-4106-85d7-793e56074bf6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1258 microversion: 2.1 time: 0.071938 Aug 19 16:35:21.675775 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 260/528] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:21 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:21.842790 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-af383108-6cbd-4f58-b6cd-7f4e3f083a05 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:21.843412 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-af383108-6cbd-4f58-b6cd-7f4e3f083a05 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:21.851621 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-af383108-6cbd-4f58-b6cd-7f4e3f083a05 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:21.852864 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-af383108-6cbd-4f58-b6cd-7f4e3f083a05 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:21.853509 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-af383108-6cbd-4f58-b6cd-7f4e3f083a05 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:21.854422 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-af383108-6cbd-4f58-b6cd-7f4e3f083a05 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:21.857215 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-af383108-6cbd-4f58-b6cd-7f4e3f083a05 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:21.857966 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-af383108-6cbd-4f58-b6cd-7f4e3f083a05 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:22.017609 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-af383108-6cbd-4f58-b6cd-7f4e3f083a05 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:22.028174 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-af383108-6cbd-4f58-b6cd-7f4e3f083a05 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.189404 Aug 19 16:35:22.029443 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 269/529] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:21 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:22.221476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-443f79d0-dd2d-416f-bf0e-3cd3868df04d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:22.222261 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-443f79d0-dd2d-416f-bf0e-3cd3868df04d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:22.229772 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-443f79d0-dd2d-416f-bf0e-3cd3868df04d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:22.234000 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-443f79d0-dd2d-416f-bf0e-3cd3868df04d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:22.234702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-443f79d0-dd2d-416f-bf0e-3cd3868df04d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:22.235419 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-443f79d0-dd2d-416f-bf0e-3cd3868df04d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:22.235873 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-443f79d0-dd2d-416f-bf0e-3cd3868df04d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:22.236298 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-443f79d0-dd2d-416f-bf0e-3cd3868df04d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:22.378396 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-443f79d0-dd2d-416f-bf0e-3cd3868df04d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:22.397993 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-443f79d0-dd2d-416f-bf0e-3cd3868df04d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:22.399545 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-443f79d0-dd2d-416f-bf0e-3cd3868df04d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:22.400791 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-443f79d0-dd2d-416f-bf0e-3cd3868df04d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.183298 Aug 19 16:35:22.401397 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 261/530] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:22 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:22.696407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6284ac2f-d4cc-44b2-9f4d-70e51fed844e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:22.697069 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6284ac2f-d4cc-44b2-9f4d-70e51fed844e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:22.702891 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6284ac2f-d4cc-44b2-9f4d-70e51fed844e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:22.703618 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6284ac2f-d4cc-44b2-9f4d-70e51fed844e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:22.704047 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6284ac2f-d4cc-44b2-9f4d-70e51fed844e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:22.704718 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6284ac2f-d4cc-44b2-9f4d-70e51fed844e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:22.705189 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6284ac2f-d4cc-44b2-9f4d-70e51fed844e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:22.705610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6284ac2f-d4cc-44b2-9f4d-70e51fed844e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:22.780395 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6284ac2f-d4cc-44b2-9f4d-70e51fed844e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:22.788324 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6284ac2f-d4cc-44b2-9f4d-70e51fed844e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1262 microversion: 2.1 time: 0.096559 Aug 19 16:35:22.788931 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 270/531] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:22 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1262 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:23.050343 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-02168647-6b11-46a9-8174-bd57fb7b2234 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:23.051052 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-02168647-6b11-46a9-8174-bd57fb7b2234 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:23.057771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-02168647-6b11-46a9-8174-bd57fb7b2234 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:23.058255 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-02168647-6b11-46a9-8174-bd57fb7b2234 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:23.058691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-02168647-6b11-46a9-8174-bd57fb7b2234 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:23.059493 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-02168647-6b11-46a9-8174-bd57fb7b2234 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:23.059834 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-02168647-6b11-46a9-8174-bd57fb7b2234 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:23.060261 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-02168647-6b11-46a9-8174-bd57fb7b2234 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:23.203674 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-02168647-6b11-46a9-8174-bd57fb7b2234 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:23.213427 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-02168647-6b11-46a9-8174-bd57fb7b2234 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.166854 Aug 19 16:35:23.227633 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 262/532] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:23 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:23.431999 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-7e1decb7-e632-4caa-84d0-59f95f06d33a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:23.432595 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-7e1decb7-e632-4caa-84d0-59f95f06d33a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:23.438966 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7e1decb7-e632-4caa-84d0-59f95f06d33a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:23.439513 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7e1decb7-e632-4caa-84d0-59f95f06d33a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:23.439940 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7e1decb7-e632-4caa-84d0-59f95f06d33a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:23.440616 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7e1decb7-e632-4caa-84d0-59f95f06d33a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:23.441125 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7e1decb7-e632-4caa-84d0-59f95f06d33a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:23.442468 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7e1decb7-e632-4caa-84d0-59f95f06d33a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:23.578369 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7e1decb7-e632-4caa-84d0-59f95f06d33a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:23.588164 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7e1decb7-e632-4caa-84d0-59f95f06d33a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:23.590010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7e1decb7-e632-4caa-84d0-59f95f06d33a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:23.591259 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-7e1decb7-e632-4caa-84d0-59f95f06d33a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.163188 Aug 19 16:35:23.592334 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 271/533] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:23 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:23.809180 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c0ce5ede-9769-44fe-adf0-fe636914f3f7 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:23.809822 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-c0ce5ede-9769-44fe-adf0-fe636914f3f7 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:23.816830 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c0ce5ede-9769-44fe-adf0-fe636914f3f7 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:23.817308 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c0ce5ede-9769-44fe-adf0-fe636914f3f7 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:23.817740 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c0ce5ede-9769-44fe-adf0-fe636914f3f7 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:23.818450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c0ce5ede-9769-44fe-adf0-fe636914f3f7 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:23.818896 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c0ce5ede-9769-44fe-adf0-fe636914f3f7 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:23.819312 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c0ce5ede-9769-44fe-adf0-fe636914f3f7 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:23.884393 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c0ce5ede-9769-44fe-adf0-fe636914f3f7 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:23.892781 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c0ce5ede-9769-44fe-adf0-fe636914f3f7 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1262 microversion: 2.1 time: 0.087375 Aug 19 16:35:23.894266 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 263/534] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:23 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:24.237725 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-37dca4d4-1e00-4129-a307-5e8330a3873f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:24.238622 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-37dca4d4-1e00-4129-a307-5e8330a3873f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:24.245060 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-37dca4d4-1e00-4129-a307-5e8330a3873f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:24.245539 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-37dca4d4-1e00-4129-a307-5e8330a3873f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:24.246004 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-37dca4d4-1e00-4129-a307-5e8330a3873f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:24.246697 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-37dca4d4-1e00-4129-a307-5e8330a3873f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:24.247177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-37dca4d4-1e00-4129-a307-5e8330a3873f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:24.247612 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-37dca4d4-1e00-4129-a307-5e8330a3873f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:24.381700 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-37dca4d4-1e00-4129-a307-5e8330a3873f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:24.390057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-37dca4d4-1e00-4129-a307-5e8330a3873f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.158037 Aug 19 16:35:24.390617 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 272/535] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:24 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:24.606770 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-729cc759-e129-49eb-be3c-2f4b3ffcac6d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1371006748", "imageRef": "da4af7b7-e205-4511-ad99-3478c2523f74", "flavorRef": "452", "networks": [{"uuid": "fdf3ee48-de6b-4ead-a10b-0bf96d819f61"}]}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:35:24.613551 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-323dd1e3-93d4-4795-afbf-ac0e51002947 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:24.614286 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-323dd1e3-93d4-4795-afbf-ac0e51002947 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:24.620694 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-323dd1e3-93d4-4795-afbf-ac0e51002947 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:24.621271 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-323dd1e3-93d4-4795-afbf-ac0e51002947 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:24.621772 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-323dd1e3-93d4-4795-afbf-ac0e51002947 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:24.622544 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-323dd1e3-93d4-4795-afbf-ac0e51002947 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:24.623069 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-323dd1e3-93d4-4795-afbf-ac0e51002947 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:24.623555 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-323dd1e3-93d4-4795-afbf-ac0e51002947 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:24.695550 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.network.neutron [None req-729cc759-e129-49eb-be3c-2f4b3ffcac6d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] validate_networks() for [('fdf3ee48-de6b-4ead-a10b-0bf96d819f61', None, None, None, None, None)] {{(pid=127284) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:35:24.777907 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-323dd1e3-93d4-4795-afbf-ac0e51002947 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:24.787290 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-323dd1e3-93d4-4795-afbf-ac0e51002947 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:24.788796 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-323dd1e3-93d4-4795-afbf-ac0e51002947 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:24.789974 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-323dd1e3-93d4-4795-afbf-ac0e51002947 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.180265 Aug 19 16:35:24.790544 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 273/536] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:24 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:35:24.913922 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4a954baa-ba98-420d-afef-43c55c8ab537 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:24.914643 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-4a954baa-ba98-420d-afef-43c55c8ab537 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:24.921540 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4a954baa-ba98-420d-afef-43c55c8ab537 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:24.922609 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4a954baa-ba98-420d-afef-43c55c8ab537 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:24.923077 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4a954baa-ba98-420d-afef-43c55c8ab537 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:24.925046 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4a954baa-ba98-420d-afef-43c55c8ab537 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:24.925548 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4a954baa-ba98-420d-afef-43c55c8ab537 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:24.925997 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4a954baa-ba98-420d-afef-43c55c8ab537 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:25.020500 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-4a954baa-ba98-420d-afef-43c55c8ab537 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:25.030455 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4a954baa-ba98-420d-afef-43c55c8ab537 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1262 microversion: 2.1 time: 0.119523 Aug 19 16:35:25.031117 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 274/537] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:24 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1262 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:25.327593 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-729cc759-e129-49eb-be3c-2f4b3ffcac6d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Flavor limits 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:35:25.328269 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-729cc759-e129-49eb-be3c-2f4b3ffcac6d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Image limits 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:35:25.328733 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-729cc759-e129-49eb-be3c-2f4b3ffcac6d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Flavor pref 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:35:25.329161 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-729cc759-e129-49eb-be3c-2f4b3ffcac6d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Image pref 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:35:25.329568 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-729cc759-e129-49eb-be3c-2f4b3ffcac6d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:35:25.339097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-729cc759-e129-49eb-be3c-2f4b3ffcac6d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:25.339703 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-729cc759-e129-49eb-be3c-2f4b3ffcac6d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:25.340209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-729cc759-e129-49eb-be3c-2f4b3ffcac6d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:25.341069 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-729cc759-e129-49eb-be3c-2f4b3ffcac6d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:25.341739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-729cc759-e129-49eb-be3c-2f4b3ffcac6d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:25.342239 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-729cc759-e129-49eb-be3c-2f4b3ffcac6d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:25.359767 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-729cc759-e129-49eb-be3c-2f4b3ffcac6d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Getting quotas for project b34c07333ddf4a19b35424d47d19dc60. Resources: {'ram', 'cores', 'instances'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:35:25.363744 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-729cc759-e129-49eb-be3c-2f4b3ffcac6d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Getting quotas for user d9e505bb350e4134976000a83bdd4fe1 and project b34c07333ddf4a19b35424d47d19dc60. Resources: {'ram', 'cores', 'instances'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:35:25.377576 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-729cc759-e129-49eb-be3c-2f4b3ffcac6d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Going to run 1 instances... {{(pid=127284) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:35:25.379991 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-729cc759-e129-49eb-be3c-2f4b3ffcac6d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='da4af7b7-e205-4511-ad99-3478c2523f74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:35:25.412671 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-50c51a73-de63-4242-987e-a93adf04bdb8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:25.413734 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-50c51a73-de63-4242-987e-a93adf04bdb8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:25.419966 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-50c51a73-de63-4242-987e-a93adf04bdb8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:25.429261 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-50c51a73-de63-4242-987e-a93adf04bdb8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:25.430485 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-50c51a73-de63-4242-987e-a93adf04bdb8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:25.430638 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-50c51a73-de63-4242-987e-a93adf04bdb8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:25.431122 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-50c51a73-de63-4242-987e-a93adf04bdb8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:25.431619 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-50c51a73-de63-4242-987e-a93adf04bdb8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:25.432326 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-729cc759-e129-49eb-be3c-2f4b3ffcac6d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.829201 Aug 19 16:35:25.433065 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 264/538] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Aug 19 16:35:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 16:35:25.444632 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-0def66c7-b83d-45f3-9f5e-894e6a1dc66c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:25.445349 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-0def66c7-b83d-45f3-9f5e-894e6a1dc66c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:25.506107 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-0def66c7-b83d-45f3-9f5e-894e6a1dc66c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:25.521385 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-0def66c7-b83d-45f3-9f5e-894e6a1dc66c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1219 microversion: 2.1 time: 0.081164 Aug 19 16:35:25.522251 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 265/539] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:25 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:25.634501 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-50c51a73-de63-4242-987e-a93adf04bdb8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:25.656490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-50c51a73-de63-4242-987e-a93adf04bdb8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.245024 Aug 19 16:35:25.656490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 275/540] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:25 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:25.812830 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2c3fbcaa-fdba-41c8-a57e-3cb09ced81b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:25.813421 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2c3fbcaa-fdba-41c8-a57e-3cb09ced81b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:25.828277 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2c3fbcaa-fdba-41c8-a57e-3cb09ced81b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:25.828788 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2c3fbcaa-fdba-41c8-a57e-3cb09ced81b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:25.829233 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2c3fbcaa-fdba-41c8-a57e-3cb09ced81b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:25.829944 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2c3fbcaa-fdba-41c8-a57e-3cb09ced81b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:25.830466 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2c3fbcaa-fdba-41c8-a57e-3cb09ced81b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:25.830813 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2c3fbcaa-fdba-41c8-a57e-3cb09ced81b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:26.041539 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2c3fbcaa-fdba-41c8-a57e-3cb09ced81b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:26.051063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0e62f7ee-8ef6-4e40-b531-7ba6dddf4cd3 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:26.051748 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-0e62f7ee-8ef6-4e40-b531-7ba6dddf4cd3 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:26.060915 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2c3fbcaa-fdba-41c8-a57e-3cb09ced81b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:26.062355 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0e62f7ee-8ef6-4e40-b531-7ba6dddf4cd3 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:26.062492 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2c3fbcaa-fdba-41c8-a57e-3cb09ced81b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:26.062967 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0e62f7ee-8ef6-4e40-b531-7ba6dddf4cd3 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:26.063497 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0e62f7ee-8ef6-4e40-b531-7ba6dddf4cd3 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:26.063608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2c3fbcaa-fdba-41c8-a57e-3cb09ced81b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.255058 Aug 19 16:35:26.064099 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 266/541] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:25 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:26.064404 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0e62f7ee-8ef6-4e40-b531-7ba6dddf4cd3 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:26.064928 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0e62f7ee-8ef6-4e40-b531-7ba6dddf4cd3 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:26.065357 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0e62f7ee-8ef6-4e40-b531-7ba6dddf4cd3 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:26.133529 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-0e62f7ee-8ef6-4e40-b531-7ba6dddf4cd3 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:26.141085 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-0e62f7ee-8ef6-4e40-b531-7ba6dddf4cd3 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1262 microversion: 2.1 time: 0.093799 Aug 19 16:35:26.141642 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 276/542] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:26 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:26.549276 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-24b48bb4-f939-4e5b-b9ea-8c8da5db6b3c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:26.550336 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-24b48bb4-f939-4e5b-b9ea-8c8da5db6b3c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:26.559213 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-24b48bb4-f939-4e5b-b9ea-8c8da5db6b3c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:26.559986 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-24b48bb4-f939-4e5b-b9ea-8c8da5db6b3c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:26.560430 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-24b48bb4-f939-4e5b-b9ea-8c8da5db6b3c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:26.561170 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-24b48bb4-f939-4e5b-b9ea-8c8da5db6b3c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:26.561631 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-24b48bb4-f939-4e5b-b9ea-8c8da5db6b3c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:26.562062 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-24b48bb4-f939-4e5b-b9ea-8c8da5db6b3c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:26.625226 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-24b48bb4-f939-4e5b-b9ea-8c8da5db6b3c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:26.633840 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-24b48bb4-f939-4e5b-b9ea-8c8da5db6b3c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1223 microversion: 2.1 time: 0.089727 Aug 19 16:35:26.634891 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 267/543] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:26 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:26.676655 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-db6f1b79-46fd-4548-8725-08861b4c1b08 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:26.677451 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-db6f1b79-46fd-4548-8725-08861b4c1b08 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:26.683856 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-db6f1b79-46fd-4548-8725-08861b4c1b08 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:26.684320 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-db6f1b79-46fd-4548-8725-08861b4c1b08 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:26.684774 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-db6f1b79-46fd-4548-8725-08861b4c1b08 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:26.685457 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-db6f1b79-46fd-4548-8725-08861b4c1b08 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:26.685909 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-db6f1b79-46fd-4548-8725-08861b4c1b08 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:26.686334 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-db6f1b79-46fd-4548-8725-08861b4c1b08 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:26.820278 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-db6f1b79-46fd-4548-8725-08861b4c1b08 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:26.829365 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-db6f1b79-46fd-4548-8725-08861b4c1b08 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.156600 Aug 19 16:35:26.840003 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 277/544] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:26 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:27.087892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-972daca8-7049-4302-a29f-1ab4c529904f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:27.088461 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-972daca8-7049-4302-a29f-1ab4c529904f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:27.094350 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-972daca8-7049-4302-a29f-1ab4c529904f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:27.094828 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-972daca8-7049-4302-a29f-1ab4c529904f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:27.095258 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-972daca8-7049-4302-a29f-1ab4c529904f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:27.095938 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-972daca8-7049-4302-a29f-1ab4c529904f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:27.096386 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-972daca8-7049-4302-a29f-1ab4c529904f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:27.096837 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-972daca8-7049-4302-a29f-1ab4c529904f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:27.162384 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-767e6e21-011c-4643-8859-2ff034542a37 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:27.162999 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-767e6e21-011c-4643-8859-2ff034542a37 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:27.168890 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-767e6e21-011c-4643-8859-2ff034542a37 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:27.169374 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-767e6e21-011c-4643-8859-2ff034542a37 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:27.169810 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-767e6e21-011c-4643-8859-2ff034542a37 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:27.170504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-767e6e21-011c-4643-8859-2ff034542a37 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:27.170955 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-767e6e21-011c-4643-8859-2ff034542a37 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:27.171388 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-767e6e21-011c-4643-8859-2ff034542a37 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:27.230812 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-972daca8-7049-4302-a29f-1ab4c529904f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:27.232198 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-767e6e21-011c-4643-8859-2ff034542a37 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:27.241366 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-972daca8-7049-4302-a29f-1ab4c529904f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:27.242245 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-767e6e21-011c-4643-8859-2ff034542a37 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1262 microversion: 2.1 time: 0.083797 Aug 19 16:35:27.242948 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-972daca8-7049-4302-a29f-1ab4c529904f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:27.244151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 278/545] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:27 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:27.248638 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-972daca8-7049-4302-a29f-1ab4c529904f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.161078 Aug 19 16:35:27.249815 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 268/546] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:27 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:27.655997 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b62fc53d-0adf-4227-9d05-bcfdc98fb49f tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:27.659533 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b62fc53d-0adf-4227-9d05-bcfdc98fb49f tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:27.666614 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b62fc53d-0adf-4227-9d05-bcfdc98fb49f tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:27.667093 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b62fc53d-0adf-4227-9d05-bcfdc98fb49f tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:27.667544 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b62fc53d-0adf-4227-9d05-bcfdc98fb49f tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:27.668388 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b62fc53d-0adf-4227-9d05-bcfdc98fb49f tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:27.668875 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b62fc53d-0adf-4227-9d05-bcfdc98fb49f tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:27.669303 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b62fc53d-0adf-4227-9d05-bcfdc98fb49f tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:27.734447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b62fc53d-0adf-4227-9d05-bcfdc98fb49f tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:27.742971 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b62fc53d-0adf-4227-9d05-bcfdc98fb49f tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1223 microversion: 2.1 time: 0.091712 Aug 19 16:35:27.743525 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 279/547] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:27 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:27.851540 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ec43c5dc-e1f6-4b85-b32f-7aaefa6688f5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:27.852101 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ec43c5dc-e1f6-4b85-b32f-7aaefa6688f5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:27.858595 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ec43c5dc-e1f6-4b85-b32f-7aaefa6688f5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:27.859075 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ec43c5dc-e1f6-4b85-b32f-7aaefa6688f5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:27.859506 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ec43c5dc-e1f6-4b85-b32f-7aaefa6688f5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:27.860201 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ec43c5dc-e1f6-4b85-b32f-7aaefa6688f5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:27.860655 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ec43c5dc-e1f6-4b85-b32f-7aaefa6688f5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:27.861107 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ec43c5dc-e1f6-4b85-b32f-7aaefa6688f5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:27.995725 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ec43c5dc-e1f6-4b85-b32f-7aaefa6688f5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:28.003817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ec43c5dc-e1f6-4b85-b32f-7aaefa6688f5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.156764 Aug 19 16:35:28.004374 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 269/548] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:27 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:28.264170 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2721b473-f19c-4227-951b-29d2ef5f67d8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:28.264800 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2721b473-f19c-4227-951b-29d2ef5f67d8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:28.271317 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2721b473-f19c-4227-951b-29d2ef5f67d8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:28.271788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2721b473-f19c-4227-951b-29d2ef5f67d8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:28.272213 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2721b473-f19c-4227-951b-29d2ef5f67d8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:28.272928 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2721b473-f19c-4227-951b-29d2ef5f67d8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:28.273093 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-eac69905-06bf-42d5-808b-7eeec4829c48 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:28.273649 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2721b473-f19c-4227-951b-29d2ef5f67d8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:28.273797 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-eac69905-06bf-42d5-808b-7eeec4829c48 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:28.273939 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2721b473-f19c-4227-951b-29d2ef5f67d8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:28.279465 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-eac69905-06bf-42d5-808b-7eeec4829c48 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:28.279945 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-eac69905-06bf-42d5-808b-7eeec4829c48 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:28.280376 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-eac69905-06bf-42d5-808b-7eeec4829c48 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:28.281090 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-eac69905-06bf-42d5-808b-7eeec4829c48 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:28.281544 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-eac69905-06bf-42d5-808b-7eeec4829c48 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:28.281964 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-eac69905-06bf-42d5-808b-7eeec4829c48 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:28.334784 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2721b473-f19c-4227-951b-29d2ef5f67d8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:28.342437 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2721b473-f19c-4227-951b-29d2ef5f67d8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1262 microversion: 2.1 time: 0.082073 Aug 19 16:35:28.342991 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 280/549] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:28 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:28.410629 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-eac69905-06bf-42d5-808b-7eeec4829c48 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:28.419462 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-eac69905-06bf-42d5-808b-7eeec4829c48 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:28.420996 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-eac69905-06bf-42d5-808b-7eeec4829c48 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:28.422142 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-eac69905-06bf-42d5-808b-7eeec4829c48 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.153965 Aug 19 16:35:28.422689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 270/550] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:28 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:35:28.763658 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-34c6990a-1427-4858-8a3e-65f08f6ba9c8 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:28.764271 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-34c6990a-1427-4858-8a3e-65f08f6ba9c8 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:28.770959 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-34c6990a-1427-4858-8a3e-65f08f6ba9c8 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:28.771449 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-34c6990a-1427-4858-8a3e-65f08f6ba9c8 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:28.771892 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-34c6990a-1427-4858-8a3e-65f08f6ba9c8 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:28.772581 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-34c6990a-1427-4858-8a3e-65f08f6ba9c8 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:28.773074 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-34c6990a-1427-4858-8a3e-65f08f6ba9c8 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:28.773504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-34c6990a-1427-4858-8a3e-65f08f6ba9c8 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:28.790802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=100 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:35:28.836991 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-34c6990a-1427-4858-8a3e-65f08f6ba9c8 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:28.844573 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-34c6990a-1427-4858-8a3e-65f08f6ba9c8 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1223 microversion: 2.1 time: 0.084804 Aug 19 16:35:28.845173 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 281/551] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:28 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:29.024842 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-82e95e77-a4bd-44da-a8ed-80308ea96a20 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:29.025474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-82e95e77-a4bd-44da-a8ed-80308ea96a20 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:29.031911 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-82e95e77-a4bd-44da-a8ed-80308ea96a20 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:29.032395 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-82e95e77-a4bd-44da-a8ed-80308ea96a20 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:29.032847 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-82e95e77-a4bd-44da-a8ed-80308ea96a20 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:29.033604 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-82e95e77-a4bd-44da-a8ed-80308ea96a20 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:29.034056 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-82e95e77-a4bd-44da-a8ed-80308ea96a20 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:29.034480 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-82e95e77-a4bd-44da-a8ed-80308ea96a20 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:29.184264 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-82e95e77-a4bd-44da-a8ed-80308ea96a20 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:29.192462 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-82e95e77-a4bd-44da-a8ed-80308ea96a20 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1724 microversion: 2.1 time: 0.171580 Aug 19 16:35:29.193040 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 271/552] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:29 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:29.363670 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-75a15ee9-a0c1-4dca-a53e-c2990e06c8d8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:29.364881 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-75a15ee9-a0c1-4dca-a53e-c2990e06c8d8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:29.370753 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-75a15ee9-a0c1-4dca-a53e-c2990e06c8d8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:29.371233 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-75a15ee9-a0c1-4dca-a53e-c2990e06c8d8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:29.371660 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-75a15ee9-a0c1-4dca-a53e-c2990e06c8d8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:29.372434 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-75a15ee9-a0c1-4dca-a53e-c2990e06c8d8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:29.372812 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-75a15ee9-a0c1-4dca-a53e-c2990e06c8d8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:29.373207 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-75a15ee9-a0c1-4dca-a53e-c2990e06c8d8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:29.431939 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-75a15ee9-a0c1-4dca-a53e-c2990e06c8d8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:29.439487 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-75a15ee9-a0c1-4dca-a53e-c2990e06c8d8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1254 microversion: 2.1 time: 0.079683 Aug 19 16:35:29.440038 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 282/553] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:29 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1254 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:29.444455 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-5b06f67e-c594-4367-86aa-b5ccad0c85e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:29.445100 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-5b06f67e-c594-4367-86aa-b5ccad0c85e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:29.451108 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5b06f67e-c594-4367-86aa-b5ccad0c85e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:29.451581 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5b06f67e-c594-4367-86aa-b5ccad0c85e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:29.452010 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5b06f67e-c594-4367-86aa-b5ccad0c85e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:29.452962 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5b06f67e-c594-4367-86aa-b5ccad0c85e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:29.453406 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5b06f67e-c594-4367-86aa-b5ccad0c85e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:29.453820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5b06f67e-c594-4367-86aa-b5ccad0c85e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:29.582128 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-5b06f67e-c594-4367-86aa-b5ccad0c85e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:29.591253 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-5b06f67e-c594-4367-86aa-b5ccad0c85e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:29.592762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-5b06f67e-c594-4367-86aa-b5ccad0c85e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:29.593913 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-5b06f67e-c594-4367-86aa-b5ccad0c85e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.153538 Aug 19 16:35:29.594463 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 272/554] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:29 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:35:29.865629 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d45b87f3-e151-4d67-840c-cdc66ad2235b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:29.866172 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d45b87f3-e151-4d67-840c-cdc66ad2235b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:29.872559 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d45b87f3-e151-4d67-840c-cdc66ad2235b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:29.873082 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d45b87f3-e151-4d67-840c-cdc66ad2235b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:29.873522 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d45b87f3-e151-4d67-840c-cdc66ad2235b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:29.874232 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d45b87f3-e151-4d67-840c-cdc66ad2235b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:29.874686 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d45b87f3-e151-4d67-840c-cdc66ad2235b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:29.875114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d45b87f3-e151-4d67-840c-cdc66ad2235b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:29.934639 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d45b87f3-e151-4d67-840c-cdc66ad2235b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:29.942709 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d45b87f3-e151-4d67-840c-cdc66ad2235b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1215 microversion: 2.1 time: 0.080827 Aug 19 16:35:29.943332 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 283/555] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:29 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:30.213741 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-adcea364-c365-4cda-bd3d-699983ce808c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:30.214280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-adcea364-c365-4cda-bd3d-699983ce808c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:30.220646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-adcea364-c365-4cda-bd3d-699983ce808c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:30.221161 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-adcea364-c365-4cda-bd3d-699983ce808c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:30.221597 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-adcea364-c365-4cda-bd3d-699983ce808c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:30.222290 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-adcea364-c365-4cda-bd3d-699983ce808c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:30.222744 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-adcea364-c365-4cda-bd3d-699983ce808c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:30.223169 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-adcea364-c365-4cda-bd3d-699983ce808c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:30.360922 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-adcea364-c365-4cda-bd3d-699983ce808c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:30.369810 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-adcea364-c365-4cda-bd3d-699983ce808c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1701 microversion: 2.1 time: 0.159962 Aug 19 16:35:30.370410 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 273/556] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:30 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1701 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:30.390916 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1934c13c-2333-4368-8fde-935a459663d2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:35:30.396985 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1934c13c-2333-4368-8fde-935a459663d2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:30.397467 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1934c13c-2333-4368-8fde-935a459663d2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:30.397897 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1934c13c-2333-4368-8fde-935a459663d2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:30.420990 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-1934c13c-2333-4368-8fde-935a459663d2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Going to try to start instance {{(pid=127285) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 19 16:35:30.460489 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-05177b70-4ec4-4534-9144-d3b7405b0c77 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:30.461256 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-05177b70-4ec4-4534-9144-d3b7405b0c77 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:30.467790 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-05177b70-4ec4-4534-9144-d3b7405b0c77 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:30.468200 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-05177b70-4ec4-4534-9144-d3b7405b0c77 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:30.468659 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-05177b70-4ec4-4534-9144-d3b7405b0c77 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:30.469052 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-1934c13c-2333-4368-8fde-935a459663d2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "POST /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199/action" status: 202 len: 0 microversion: 2.1 time: 0.081279 Aug 19 16:35:30.469820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-05177b70-4ec4-4534-9144-d3b7405b0c77 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:30.470359 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 284/557] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Aug 19 16:35:30 2022] POST /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:35:30.470980 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-05177b70-4ec4-4534-9144-d3b7405b0c77 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:30.471412 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-05177b70-4ec4-4534-9144-d3b7405b0c77 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:30.479438 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f7967411-09a5-4c95-80a9-8a786738eb9f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:30.480124 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f7967411-09a5-4c95-80a9-8a786738eb9f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:30.486699 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f7967411-09a5-4c95-80a9-8a786738eb9f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:30.486845 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f7967411-09a5-4c95-80a9-8a786738eb9f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:30.487294 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f7967411-09a5-4c95-80a9-8a786738eb9f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:30.488124 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f7967411-09a5-4c95-80a9-8a786738eb9f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:30.489536 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f7967411-09a5-4c95-80a9-8a786738eb9f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:30.489536 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f7967411-09a5-4c95-80a9-8a786738eb9f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:30.539364 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-05177b70-4ec4-4534-9144-d3b7405b0c77 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:30.547071 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-05177b70-4ec4-4534-9144-d3b7405b0c77 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1310 microversion: 2.1 time: 0.091056 Aug 19 16:35:30.547627 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 274/558] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:30 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1310 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:30.618058 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2cddd547-ab79-4b5b-815c-5a95835c13ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:30.618675 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2cddd547-ab79-4b5b-815c-5a95835c13ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:30.621805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f7967411-09a5-4c95-80a9-8a786738eb9f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:30.624809 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2cddd547-ab79-4b5b-815c-5a95835c13ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:30.625300 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2cddd547-ab79-4b5b-815c-5a95835c13ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:30.625741 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2cddd547-ab79-4b5b-815c-5a95835c13ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:30.626433 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2cddd547-ab79-4b5b-815c-5a95835c13ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:30.626887 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2cddd547-ab79-4b5b-815c-5a95835c13ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:30.627315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2cddd547-ab79-4b5b-815c-5a95835c13ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:30.630412 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f7967411-09a5-4c95-80a9-8a786738eb9f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1710 microversion: 2.1 time: 0.155425 Aug 19 16:35:30.631073 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 285/559] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:30 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:30.761395 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2cddd547-ab79-4b5b-815c-5a95835c13ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:30.764805 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=100 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:35:30.771138 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2cddd547-ab79-4b5b-815c-5a95835c13ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:30.772643 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2cddd547-ab79-4b5b-815c-5a95835c13ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:30.773832 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2cddd547-ab79-4b5b-815c-5a95835c13ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.160731 Aug 19 16:35:30.774380 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 275/560] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:30 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:35:30.964354 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d0f6f3f4-a64d-491d-a214-736a823d9c0b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:30.965013 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d0f6f3f4-a64d-491d-a214-736a823d9c0b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:30.971411 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d0f6f3f4-a64d-491d-a214-736a823d9c0b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:30.971890 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d0f6f3f4-a64d-491d-a214-736a823d9c0b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:30.972319 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d0f6f3f4-a64d-491d-a214-736a823d9c0b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:30.973027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d0f6f3f4-a64d-491d-a214-736a823d9c0b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:30.974882 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d0f6f3f4-a64d-491d-a214-736a823d9c0b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:30.975342 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d0f6f3f4-a64d-491d-a214-736a823d9c0b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:31.035438 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d0f6f3f4-a64d-491d-a214-736a823d9c0b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:31.043561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d0f6f3f4-a64d-491d-a214-736a823d9c0b tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1279 microversion: 2.1 time: 0.083174 Aug 19 16:35:31.044110 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 286/561] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:30 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1279 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:31.569469 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1e2ca3bb-43f8-478b-ba0b-09f9f367496a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:31.570075 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1e2ca3bb-43f8-478b-ba0b-09f9f367496a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:31.576524 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1e2ca3bb-43f8-478b-ba0b-09f9f367496a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:31.577042 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1e2ca3bb-43f8-478b-ba0b-09f9f367496a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:31.577470 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1e2ca3bb-43f8-478b-ba0b-09f9f367496a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:31.578413 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1e2ca3bb-43f8-478b-ba0b-09f9f367496a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:31.578863 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1e2ca3bb-43f8-478b-ba0b-09f9f367496a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:31.579289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1e2ca3bb-43f8-478b-ba0b-09f9f367496a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:31.644110 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1e2ca3bb-43f8-478b-ba0b-09f9f367496a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:31.652246 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b9028f4e-7e09-4a32-8285-e6b6e76f8f30 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:31.653124 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b9028f4e-7e09-4a32-8285-e6b6e76f8f30 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:31.654118 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1e2ca3bb-43f8-478b-ba0b-09f9f367496a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1328 microversion: 2.1 time: 0.088943 Aug 19 16:35:31.667111 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 276/562] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:31 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1328 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:31.667882 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=2 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:35:31.667882 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=10 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:35:31.667882 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b9028f4e-7e09-4a32-8285-e6b6e76f8f30 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:31.667882 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b9028f4e-7e09-4a32-8285-e6b6e76f8f30 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:31.668472 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b9028f4e-7e09-4a32-8285-e6b6e76f8f30 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:31.669393 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b9028f4e-7e09-4a32-8285-e6b6e76f8f30 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:31.669936 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b9028f4e-7e09-4a32-8285-e6b6e76f8f30 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:31.670503 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b9028f4e-7e09-4a32-8285-e6b6e76f8f30 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:31.798579 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d11a7af6-47af-4b64-97fa-ef5660909135 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:31.799404 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d11a7af6-47af-4b64-97fa-ef5660909135 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:31.809259 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d11a7af6-47af-4b64-97fa-ef5660909135 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:31.809964 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d11a7af6-47af-4b64-97fa-ef5660909135 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:31.810845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d11a7af6-47af-4b64-97fa-ef5660909135 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:31.811923 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d11a7af6-47af-4b64-97fa-ef5660909135 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:31.813426 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d11a7af6-47af-4b64-97fa-ef5660909135 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:31.814082 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d11a7af6-47af-4b64-97fa-ef5660909135 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:31.936187 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b9028f4e-7e09-4a32-8285-e6b6e76f8f30 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:31.945358 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b9028f4e-7e09-4a32-8285-e6b6e76f8f30 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1710 microversion: 2.1 time: 0.297532 Aug 19 16:35:31.959528 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 287/563] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:31 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1710 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:32.041033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d11a7af6-47af-4b64-97fa-ef5660909135 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:32.050935 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d11a7af6-47af-4b64-97fa-ef5660909135 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:32.053400 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d11a7af6-47af-4b64-97fa-ef5660909135 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:32.054961 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d11a7af6-47af-4b64-97fa-ef5660909135 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.260453 Aug 19 16:35:32.055704 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 277/564] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:31 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:35:32.064814 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8bb18318-239f-44ff-84d7-107e313a7537 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:32.065680 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8bb18318-239f-44ff-84d7-107e313a7537 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:32.080126 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8bb18318-239f-44ff-84d7-107e313a7537 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:32.080910 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8bb18318-239f-44ff-84d7-107e313a7537 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:32.081560 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8bb18318-239f-44ff-84d7-107e313a7537 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:32.083129 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8bb18318-239f-44ff-84d7-107e313a7537 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:32.084091 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8bb18318-239f-44ff-84d7-107e313a7537 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:32.084671 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8bb18318-239f-44ff-84d7-107e313a7537 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:32.290816 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-8bb18318-239f-44ff-84d7-107e313a7537 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:32.318650 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8bb18318-239f-44ff-84d7-107e313a7537 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1277 microversion: 2.1 time: 0.256271 Aug 19 16:35:32.337195 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 288/565] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:32 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1277 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:32.674889 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-58d6fa5d-66d1-4aae-af5a-c041fc01502d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:32.675690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-58d6fa5d-66d1-4aae-af5a-c041fc01502d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:32.683749 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-58d6fa5d-66d1-4aae-af5a-c041fc01502d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:32.688361 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-58d6fa5d-66d1-4aae-af5a-c041fc01502d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:32.689105 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-58d6fa5d-66d1-4aae-af5a-c041fc01502d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:32.690069 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-58d6fa5d-66d1-4aae-af5a-c041fc01502d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:32.691231 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-58d6fa5d-66d1-4aae-af5a-c041fc01502d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:32.692366 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-58d6fa5d-66d1-4aae-af5a-c041fc01502d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:32.847609 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-58d6fa5d-66d1-4aae-af5a-c041fc01502d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:32.855675 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-58d6fa5d-66d1-4aae-af5a-c041fc01502d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.184706 Aug 19 16:35:32.865623 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 278/566] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:32 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:32.968129 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0c3bbbb2-939b-4f71-a952-bc5feba76316 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:32.968666 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-0c3bbbb2-939b-4f71-a952-bc5feba76316 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:32.975473 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0c3bbbb2-939b-4f71-a952-bc5feba76316 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:32.975961 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0c3bbbb2-939b-4f71-a952-bc5feba76316 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:32.976396 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0c3bbbb2-939b-4f71-a952-bc5feba76316 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:32.977137 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0c3bbbb2-939b-4f71-a952-bc5feba76316 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:32.977592 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0c3bbbb2-939b-4f71-a952-bc5feba76316 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:32.978009 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0c3bbbb2-939b-4f71-a952-bc5feba76316 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:33.077277 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8ce13325-9963-4b43-9ea5-351a5452340a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:33.078136 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8ce13325-9963-4b43-9ea5-351a5452340a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:33.084700 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8ce13325-9963-4b43-9ea5-351a5452340a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:33.085243 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8ce13325-9963-4b43-9ea5-351a5452340a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:33.085678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8ce13325-9963-4b43-9ea5-351a5452340a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:33.086395 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8ce13325-9963-4b43-9ea5-351a5452340a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:33.086877 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8ce13325-9963-4b43-9ea5-351a5452340a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:33.087275 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8ce13325-9963-4b43-9ea5-351a5452340a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:33.117680 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-0c3bbbb2-939b-4f71-a952-bc5feba76316 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:33.126248 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-0c3bbbb2-939b-4f71-a952-bc5feba76316 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1710 microversion: 2.1 time: 0.162239 Aug 19 16:35:33.136782 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 289/567] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:32 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1710 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:33.233521 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8ce13325-9963-4b43-9ea5-351a5452340a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:33.243386 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8ce13325-9963-4b43-9ea5-351a5452340a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:33.244846 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8ce13325-9963-4b43-9ea5-351a5452340a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:33.246162 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8ce13325-9963-4b43-9ea5-351a5452340a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.172725 Aug 19 16:35:33.246849 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 279/568] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:33 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:35:33.344935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d2066bfd-eba6-43b0-9a8c-7e82a161057c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:33.345553 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d2066bfd-eba6-43b0-9a8c-7e82a161057c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:33.351869 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2066bfd-eba6-43b0-9a8c-7e82a161057c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:33.352364 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2066bfd-eba6-43b0-9a8c-7e82a161057c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:33.352826 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2066bfd-eba6-43b0-9a8c-7e82a161057c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:33.353531 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2066bfd-eba6-43b0-9a8c-7e82a161057c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:33.353988 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2066bfd-eba6-43b0-9a8c-7e82a161057c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:33.354417 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2066bfd-eba6-43b0-9a8c-7e82a161057c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:33.496951 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d2066bfd-eba6-43b0-9a8c-7e82a161057c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:33.506003 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d2066bfd-eba6-43b0-9a8c-7e82a161057c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.165107 Aug 19 16:35:33.506584 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 290/569] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:33 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:33.877368 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-0cf84892-c752-4e5b-846b-3459ae03aa6c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:33.877915 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-0cf84892-c752-4e5b-846b-3459ae03aa6c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:33.881378 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:35:33.885582 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0cf84892-c752-4e5b-846b-3459ae03aa6c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:33.886058 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0cf84892-c752-4e5b-846b-3459ae03aa6c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:33.886483 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0cf84892-c752-4e5b-846b-3459ae03aa6c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:33.887165 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0cf84892-c752-4e5b-846b-3459ae03aa6c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:33.887611 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0cf84892-c752-4e5b-846b-3459ae03aa6c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:33.888033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0cf84892-c752-4e5b-846b-3459ae03aa6c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:34.021881 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-0cf84892-c752-4e5b-846b-3459ae03aa6c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:34.029693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-0cf84892-c752-4e5b-846b-3459ae03aa6c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.156279 Aug 19 16:35:34.030270 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 280/570] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:33 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:34.152259 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-cca3584b-88bf-4fd8-a053-010ff5c91edd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:34.152860 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-cca3584b-88bf-4fd8-a053-010ff5c91edd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:34.159386 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cca3584b-88bf-4fd8-a053-010ff5c91edd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:34.159858 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cca3584b-88bf-4fd8-a053-010ff5c91edd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:34.160288 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cca3584b-88bf-4fd8-a053-010ff5c91edd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:34.161777 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cca3584b-88bf-4fd8-a053-010ff5c91edd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:34.162239 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cca3584b-88bf-4fd8-a053-010ff5c91edd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:34.162665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cca3584b-88bf-4fd8-a053-010ff5c91edd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:34.271914 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-420fb6c8-d171-4b22-b43e-1b28f7a5bb02 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:34.272636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-420fb6c8-d171-4b22-b43e-1b28f7a5bb02 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:34.279070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-420fb6c8-d171-4b22-b43e-1b28f7a5bb02 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:34.279733 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-420fb6c8-d171-4b22-b43e-1b28f7a5bb02 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:34.280175 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-420fb6c8-d171-4b22-b43e-1b28f7a5bb02 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:34.280906 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-420fb6c8-d171-4b22-b43e-1b28f7a5bb02 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:34.281363 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-420fb6c8-d171-4b22-b43e-1b28f7a5bb02 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:34.281788 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-420fb6c8-d171-4b22-b43e-1b28f7a5bb02 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:34.309515 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-cca3584b-88bf-4fd8-a053-010ff5c91edd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:34.332182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-cca3584b-88bf-4fd8-a053-010ff5c91edd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1710 microversion: 2.1 time: 0.183707 Aug 19 16:35:34.336661 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 291/571] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:34 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1710 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:34.435864 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-420fb6c8-d171-4b22-b43e-1b28f7a5bb02 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:34.446009 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-420fb6c8-d171-4b22-b43e-1b28f7a5bb02 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:34.447533 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-420fb6c8-d171-4b22-b43e-1b28f7a5bb02 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:34.448683 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-420fb6c8-d171-4b22-b43e-1b28f7a5bb02 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.181484 Aug 19 16:35:34.449270 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 281/572] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:34 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:35:34.530885 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-97e4811f-92fe-4dc5-90d7-3295b7572418 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:34.531579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-97e4811f-92fe-4dc5-90d7-3295b7572418 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:34.537986 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-97e4811f-92fe-4dc5-90d7-3295b7572418 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:34.538467 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-97e4811f-92fe-4dc5-90d7-3295b7572418 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:34.538906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-97e4811f-92fe-4dc5-90d7-3295b7572418 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:34.539608 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-97e4811f-92fe-4dc5-90d7-3295b7572418 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:34.540090 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-97e4811f-92fe-4dc5-90d7-3295b7572418 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:34.540512 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-97e4811f-92fe-4dc5-90d7-3295b7572418 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:34.678909 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-97e4811f-92fe-4dc5-90d7-3295b7572418 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:34.687339 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-97e4811f-92fe-4dc5-90d7-3295b7572418 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.163743 Aug 19 16:35:34.688016 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 292/573] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:34 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:35.052375 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f8e75ab5-9409-42a8-b128-7dc6d9aa9bfc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:35.053045 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f8e75ab5-9409-42a8-b128-7dc6d9aa9bfc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:35.059489 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f8e75ab5-9409-42a8-b128-7dc6d9aa9bfc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:35.059961 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f8e75ab5-9409-42a8-b128-7dc6d9aa9bfc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:35.060394 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f8e75ab5-9409-42a8-b128-7dc6d9aa9bfc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:35.061111 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f8e75ab5-9409-42a8-b128-7dc6d9aa9bfc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:35.061552 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f8e75ab5-9409-42a8-b128-7dc6d9aa9bfc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:35.061967 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f8e75ab5-9409-42a8-b128-7dc6d9aa9bfc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:35.198609 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f8e75ab5-9409-42a8-b128-7dc6d9aa9bfc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:35.207364 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f8e75ab5-9409-42a8-b128-7dc6d9aa9bfc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.160002 Aug 19 16:35:35.208553 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 282/574] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:35 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:35.354561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-282e1b17-061a-406f-8020-b6f558035495 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:35.355242 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-282e1b17-061a-406f-8020-b6f558035495 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:35.361902 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-282e1b17-061a-406f-8020-b6f558035495 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:35.362397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-282e1b17-061a-406f-8020-b6f558035495 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:35.362834 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-282e1b17-061a-406f-8020-b6f558035495 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:35.363561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-282e1b17-061a-406f-8020-b6f558035495 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:35.363996 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-282e1b17-061a-406f-8020-b6f558035495 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:35.364424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-282e1b17-061a-406f-8020-b6f558035495 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:35.471303 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f11ab6d9-193a-4e4d-ba16-44d3b7ed1ab8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:35.471994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f11ab6d9-193a-4e4d-ba16-44d3b7ed1ab8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:35.473955 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=2 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:35:35.479665 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f11ab6d9-193a-4e4d-ba16-44d3b7ed1ab8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:35.479665 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f11ab6d9-193a-4e4d-ba16-44d3b7ed1ab8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:35.479844 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f11ab6d9-193a-4e4d-ba16-44d3b7ed1ab8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:35.480527 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f11ab6d9-193a-4e4d-ba16-44d3b7ed1ab8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:35.481006 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f11ab6d9-193a-4e4d-ba16-44d3b7ed1ab8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:35.481423 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f11ab6d9-193a-4e4d-ba16-44d3b7ed1ab8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:35.501776 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-282e1b17-061a-406f-8020-b6f558035495 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:35.511698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-282e1b17-061a-406f-8020-b6f558035495 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1710 microversion: 2.1 time: 0.160921 Aug 19 16:35:35.512915 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 293/575] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:35 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:35.517595 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=10 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:35:35.633301 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f11ab6d9-193a-4e4d-ba16-44d3b7ed1ab8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:35.643772 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f11ab6d9-193a-4e4d-ba16-44d3b7ed1ab8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:35.645973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f11ab6d9-193a-4e4d-ba16-44d3b7ed1ab8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:35.647164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f11ab6d9-193a-4e4d-ba16-44d3b7ed1ab8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.179725 Aug 19 16:35:35.647732 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 283/576] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:35 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:35:35.709704 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-501b1812-97df-4bc5-91eb-afab0bedf6cc tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:35.710363 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-501b1812-97df-4bc5-91eb-afab0bedf6cc tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:35.712218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:35:35.717639 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-501b1812-97df-4bc5-91eb-afab0bedf6cc tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:35.718129 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-501b1812-97df-4bc5-91eb-afab0bedf6cc tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:35.718567 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-501b1812-97df-4bc5-91eb-afab0bedf6cc tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:35.719270 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-501b1812-97df-4bc5-91eb-afab0bedf6cc tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:35.719725 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-501b1812-97df-4bc5-91eb-afab0bedf6cc tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:35.720153 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-501b1812-97df-4bc5-91eb-afab0bedf6cc tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:35.856411 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-501b1812-97df-4bc5-91eb-afab0bedf6cc tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:35.865102 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-501b1812-97df-4bc5-91eb-afab0bedf6cc tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.159355 Aug 19 16:35:35.865610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 294/577] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:35 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:36.228890 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-dee79f0f-c011-4b8f-a372-27bb858f302d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:36.229436 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-dee79f0f-c011-4b8f-a372-27bb858f302d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:36.235843 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dee79f0f-c011-4b8f-a372-27bb858f302d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:36.236325 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dee79f0f-c011-4b8f-a372-27bb858f302d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:36.236784 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dee79f0f-c011-4b8f-a372-27bb858f302d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:36.237479 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dee79f0f-c011-4b8f-a372-27bb858f302d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:36.237927 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dee79f0f-c011-4b8f-a372-27bb858f302d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:36.238349 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dee79f0f-c011-4b8f-a372-27bb858f302d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:36.370824 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-dee79f0f-c011-4b8f-a372-27bb858f302d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:36.378807 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-dee79f0f-c011-4b8f-a372-27bb858f302d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.153717 Aug 19 16:35:36.380264 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 284/578] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:36 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:36.533762 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ae37dc62-3500-402e-a0bc-0a7c710110ad tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:36.534606 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ae37dc62-3500-402e-a0bc-0a7c710110ad tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:36.542193 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ae37dc62-3500-402e-a0bc-0a7c710110ad tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:36.542715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ae37dc62-3500-402e-a0bc-0a7c710110ad tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:36.543225 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ae37dc62-3500-402e-a0bc-0a7c710110ad tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:36.543950 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ae37dc62-3500-402e-a0bc-0a7c710110ad tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:36.544424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ae37dc62-3500-402e-a0bc-0a7c710110ad tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:36.545062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ae37dc62-3500-402e-a0bc-0a7c710110ad tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:36.670252 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d52e3bc6-6bba-4b27-85b8-8582dc94949f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:36.670478 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d52e3bc6-6bba-4b27-85b8-8582dc94949f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:36.680718 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ae37dc62-3500-402e-a0bc-0a7c710110ad tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:36.686596 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d52e3bc6-6bba-4b27-85b8-8582dc94949f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:36.687335 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d52e3bc6-6bba-4b27-85b8-8582dc94949f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:36.688020 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d52e3bc6-6bba-4b27-85b8-8582dc94949f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:36.688731 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d52e3bc6-6bba-4b27-85b8-8582dc94949f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:36.689024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ae37dc62-3500-402e-a0bc-0a7c710110ad tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1710 microversion: 2.1 time: 0.159162 Aug 19 16:35:36.689211 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d52e3bc6-6bba-4b27-85b8-8582dc94949f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:36.689601 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 295/579] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:36 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1710 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:36.689718 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d52e3bc6-6bba-4b27-85b8-8582dc94949f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:36.833393 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d52e3bc6-6bba-4b27-85b8-8582dc94949f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:36.842903 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d52e3bc6-6bba-4b27-85b8-8582dc94949f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:36.844413 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d52e3bc6-6bba-4b27-85b8-8582dc94949f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:36.845607 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d52e3bc6-6bba-4b27-85b8-8582dc94949f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.179668 Aug 19 16:35:36.846323 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 285/580] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:36 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:35:36.886289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-50d328a4-0536-45df-9250-1ea14fc385e1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:36.886883 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-50d328a4-0536-45df-9250-1ea14fc385e1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:36.893031 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-50d328a4-0536-45df-9250-1ea14fc385e1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:36.893465 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-50d328a4-0536-45df-9250-1ea14fc385e1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:36.893896 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-50d328a4-0536-45df-9250-1ea14fc385e1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:36.894579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-50d328a4-0536-45df-9250-1ea14fc385e1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:36.895565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-50d328a4-0536-45df-9250-1ea14fc385e1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:36.896385 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-50d328a4-0536-45df-9250-1ea14fc385e1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:37.256103 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-50d328a4-0536-45df-9250-1ea14fc385e1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:37.265104 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-50d328a4-0536-45df-9250-1ea14fc385e1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.382737 Aug 19 16:35:37.265800 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 296/581] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:36 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:37.399944 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-af1ab014-d04d-4c76-8a8f-192eb58bf9fb tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:37.400836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-af1ab014-d04d-4c76-8a8f-192eb58bf9fb tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:37.407959 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-af1ab014-d04d-4c76-8a8f-192eb58bf9fb tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:37.408443 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-af1ab014-d04d-4c76-8a8f-192eb58bf9fb tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:37.408974 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-af1ab014-d04d-4c76-8a8f-192eb58bf9fb tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:37.409691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-af1ab014-d04d-4c76-8a8f-192eb58bf9fb tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:37.410115 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-af1ab014-d04d-4c76-8a8f-192eb58bf9fb tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:37.411740 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-af1ab014-d04d-4c76-8a8f-192eb58bf9fb tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:37.547937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-af1ab014-d04d-4c76-8a8f-192eb58bf9fb tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:37.557343 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-af1ab014-d04d-4c76-8a8f-192eb58bf9fb tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.161373 Aug 19 16:35:37.558385 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 286/582] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:37 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:37.712077 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-7e99d9b4-7012-4025-a780-3c4ac956095f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:37.712679 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-7e99d9b4-7012-4025-a780-3c4ac956095f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:37.719369 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7e99d9b4-7012-4025-a780-3c4ac956095f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:37.719854 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7e99d9b4-7012-4025-a780-3c4ac956095f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:37.720293 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7e99d9b4-7012-4025-a780-3c4ac956095f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:37.721019 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7e99d9b4-7012-4025-a780-3c4ac956095f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:37.721476 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7e99d9b4-7012-4025-a780-3c4ac956095f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:37.721905 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7e99d9b4-7012-4025-a780-3c4ac956095f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:37.728023 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:35:37.861616 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7e99d9b4-7012-4025-a780-3c4ac956095f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:37.869834 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-47bccb5b-487d-47d1-be37-3cf789d7ea82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:37.870441 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-47bccb5b-487d-47d1-be37-3cf789d7ea82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:37.870827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-7e99d9b4-7012-4025-a780-3c4ac956095f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1710 microversion: 2.1 time: 0.163205 Aug 19 16:35:37.871579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 297/583] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:37 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1710 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:37.890613 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-47bccb5b-487d-47d1-be37-3cf789d7ea82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:37.891134 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-47bccb5b-487d-47d1-be37-3cf789d7ea82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:37.891534 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-47bccb5b-487d-47d1-be37-3cf789d7ea82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:37.892244 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-47bccb5b-487d-47d1-be37-3cf789d7ea82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:37.892770 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-47bccb5b-487d-47d1-be37-3cf789d7ea82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:37.893198 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-47bccb5b-487d-47d1-be37-3cf789d7ea82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:38.031704 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-47bccb5b-487d-47d1-be37-3cf789d7ea82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:38.043076 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-47bccb5b-487d-47d1-be37-3cf789d7ea82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:38.044914 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-47bccb5b-487d-47d1-be37-3cf789d7ea82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:38.046094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-47bccb5b-487d-47d1-be37-3cf789d7ea82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.180119 Aug 19 16:35:38.047030 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 287/584] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:37 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:35:38.286045 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-7ba85d7e-8ebb-4ff8-a85e-84eb3178b42e tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:38.287001 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-7ba85d7e-8ebb-4ff8-a85e-84eb3178b42e tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:38.293150 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7ba85d7e-8ebb-4ff8-a85e-84eb3178b42e tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:38.293642 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7ba85d7e-8ebb-4ff8-a85e-84eb3178b42e tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:38.294075 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7ba85d7e-8ebb-4ff8-a85e-84eb3178b42e tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:38.294773 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7ba85d7e-8ebb-4ff8-a85e-84eb3178b42e tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:38.295231 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7ba85d7e-8ebb-4ff8-a85e-84eb3178b42e tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:38.295657 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7ba85d7e-8ebb-4ff8-a85e-84eb3178b42e tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:38.428997 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7ba85d7e-8ebb-4ff8-a85e-84eb3178b42e tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:38.437483 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-7ba85d7e-8ebb-4ff8-a85e-84eb3178b42e tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.155906 Aug 19 16:35:38.438314 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 298/585] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:38 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:38.578597 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-33587d80-08d7-4bb7-badd-2c97df45907e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:38.579345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-33587d80-08d7-4bb7-badd-2c97df45907e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:38.586406 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-33587d80-08d7-4bb7-badd-2c97df45907e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:38.586876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-33587d80-08d7-4bb7-badd-2c97df45907e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:38.587305 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-33587d80-08d7-4bb7-badd-2c97df45907e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:38.588002 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-33587d80-08d7-4bb7-badd-2c97df45907e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:38.588442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-33587d80-08d7-4bb7-badd-2c97df45907e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:38.588914 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-33587d80-08d7-4bb7-badd-2c97df45907e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:38.734236 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-33587d80-08d7-4bb7-badd-2c97df45907e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:38.742950 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-33587d80-08d7-4bb7-badd-2c97df45907e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.168460 Aug 19 16:35:38.743710 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 288/586] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:38 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:38.896018 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2473e1cb-95ab-41cb-b44d-922100746275 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:38.896779 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2473e1cb-95ab-41cb-b44d-922100746275 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:38.903838 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2473e1cb-95ab-41cb-b44d-922100746275 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:38.904332 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2473e1cb-95ab-41cb-b44d-922100746275 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:38.904778 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2473e1cb-95ab-41cb-b44d-922100746275 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:38.905469 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2473e1cb-95ab-41cb-b44d-922100746275 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:38.905919 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2473e1cb-95ab-41cb-b44d-922100746275 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:38.906342 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2473e1cb-95ab-41cb-b44d-922100746275 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:39.038837 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2473e1cb-95ab-41cb-b44d-922100746275 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:39.047090 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2473e1cb-95ab-41cb-b44d-922100746275 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1710 microversion: 2.1 time: 0.155911 Aug 19 16:35:39.047665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 299/587] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:38 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:39.069136 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a2143e5d-3746-47d0-a966-201b8e789125 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:39.069941 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a2143e5d-3746-47d0-a966-201b8e789125 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:39.076047 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a2143e5d-3746-47d0-a966-201b8e789125 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:39.076535 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a2143e5d-3746-47d0-a966-201b8e789125 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:39.077000 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a2143e5d-3746-47d0-a966-201b8e789125 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:39.077963 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a2143e5d-3746-47d0-a966-201b8e789125 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:39.078419 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a2143e5d-3746-47d0-a966-201b8e789125 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:39.078855 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a2143e5d-3746-47d0-a966-201b8e789125 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:39.213651 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a2143e5d-3746-47d0-a966-201b8e789125 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:39.223719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a2143e5d-3746-47d0-a966-201b8e789125 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:39.225095 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a2143e5d-3746-47d0-a966-201b8e789125 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:39.226216 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a2143e5d-3746-47d0-a966-201b8e789125 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.161273 Aug 19 16:35:39.226774 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 289/588] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:39 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:39.460720 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e02e21fb-3b81-481d-b6a0-cafb5ebb155c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:39.461276 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e02e21fb-3b81-481d-b6a0-cafb5ebb155c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:39.467633 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e02e21fb-3b81-481d-b6a0-cafb5ebb155c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:39.468120 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e02e21fb-3b81-481d-b6a0-cafb5ebb155c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:39.468553 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e02e21fb-3b81-481d-b6a0-cafb5ebb155c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:39.469278 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e02e21fb-3b81-481d-b6a0-cafb5ebb155c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:39.469730 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e02e21fb-3b81-481d-b6a0-cafb5ebb155c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:39.470156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e02e21fb-3b81-481d-b6a0-cafb5ebb155c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:39.602692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e02e21fb-3b81-481d-b6a0-cafb5ebb155c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:39.610490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e02e21fb-3b81-481d-b6a0-cafb5ebb155c tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.155496 Aug 19 16:35:39.611146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 300/589] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:39 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:39.764784 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-53f92f8c-4e67-4f20-be34-4e2408d0be86 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:39.766447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-53f92f8c-4e67-4f20-be34-4e2408d0be86 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:39.774774 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53f92f8c-4e67-4f20-be34-4e2408d0be86 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:39.775342 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53f92f8c-4e67-4f20-be34-4e2408d0be86 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:39.775884 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53f92f8c-4e67-4f20-be34-4e2408d0be86 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:39.776647 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53f92f8c-4e67-4f20-be34-4e2408d0be86 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:39.777148 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53f92f8c-4e67-4f20-be34-4e2408d0be86 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:39.777573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53f92f8c-4e67-4f20-be34-4e2408d0be86 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:39.912654 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-53f92f8c-4e67-4f20-be34-4e2408d0be86 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:39.920516 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-53f92f8c-4e67-4f20-be34-4e2408d0be86 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.160932 Aug 19 16:35:39.923054 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 290/590] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:39 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:40.069576 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d7dd685e-281e-4645-ab30-ee31a1295452 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:40.070146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d7dd685e-281e-4645-ab30-ee31a1295452 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:40.076905 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d7dd685e-281e-4645-ab30-ee31a1295452 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:40.077981 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d7dd685e-281e-4645-ab30-ee31a1295452 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:40.078644 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d7dd685e-281e-4645-ab30-ee31a1295452 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:40.079583 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d7dd685e-281e-4645-ab30-ee31a1295452 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:40.080254 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d7dd685e-281e-4645-ab30-ee31a1295452 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:40.080982 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d7dd685e-281e-4645-ab30-ee31a1295452 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:40.222910 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d7dd685e-281e-4645-ab30-ee31a1295452 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:40.231148 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d7dd685e-281e-4645-ab30-ee31a1295452 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1710 microversion: 2.1 time: 0.165654 Aug 19 16:35:40.231708 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 301/591] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:40 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1710 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:40.248675 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-dbd46731-fae4-4719-a46a-07714fbc1d80 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:40.249238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-dbd46731-fae4-4719-a46a-07714fbc1d80 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:40.256285 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dbd46731-fae4-4719-a46a-07714fbc1d80 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:40.256963 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dbd46731-fae4-4719-a46a-07714fbc1d80 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:40.257397 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dbd46731-fae4-4719-a46a-07714fbc1d80 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:40.258097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dbd46731-fae4-4719-a46a-07714fbc1d80 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:40.258803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dbd46731-fae4-4719-a46a-07714fbc1d80 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:40.259234 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dbd46731-fae4-4719-a46a-07714fbc1d80 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:40.393784 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-dbd46731-fae4-4719-a46a-07714fbc1d80 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:40.402533 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-dbd46731-fae4-4719-a46a-07714fbc1d80 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:40.404020 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-dbd46731-fae4-4719-a46a-07714fbc1d80 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:40.405205 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-dbd46731-fae4-4719-a46a-07714fbc1d80 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.160589 Aug 19 16:35:40.412810 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 291/592] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:40 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:40.632242 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-bf8c87eb-cb9c-4081-a6e9-90849fa29ff0 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:40.632696 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-bf8c87eb-cb9c-4081-a6e9-90849fa29ff0 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:40.639017 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bf8c87eb-cb9c-4081-a6e9-90849fa29ff0 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:40.639505 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bf8c87eb-cb9c-4081-a6e9-90849fa29ff0 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:40.639932 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bf8c87eb-cb9c-4081-a6e9-90849fa29ff0 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:40.640626 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bf8c87eb-cb9c-4081-a6e9-90849fa29ff0 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:40.641097 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bf8c87eb-cb9c-4081-a6e9-90849fa29ff0 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:40.641514 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bf8c87eb-cb9c-4081-a6e9-90849fa29ff0 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:40.784717 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-bf8c87eb-cb9c-4081-a6e9-90849fa29ff0 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:40.792816 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-bf8c87eb-cb9c-4081-a6e9-90849fa29ff0 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.165154 Aug 19 16:35:40.793393 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 302/593] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:40 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:40.942616 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-09d03abb-745b-4f4e-97a2-1ddf13121e08 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:40.943188 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-09d03abb-745b-4f4e-97a2-1ddf13121e08 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:40.949782 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-09d03abb-745b-4f4e-97a2-1ddf13121e08 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:40.950264 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-09d03abb-745b-4f4e-97a2-1ddf13121e08 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:40.950699 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-09d03abb-745b-4f4e-97a2-1ddf13121e08 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:40.951397 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-09d03abb-745b-4f4e-97a2-1ddf13121e08 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:40.951847 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-09d03abb-745b-4f4e-97a2-1ddf13121e08 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:40.952534 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-09d03abb-745b-4f4e-97a2-1ddf13121e08 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:40.971983 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=100 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:35:41.087026 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-09d03abb-745b-4f4e-97a2-1ddf13121e08 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:41.094761 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-09d03abb-745b-4f4e-97a2-1ddf13121e08 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.156209 Aug 19 16:35:41.095317 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 292/594] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:40 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:41.252961 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-03b37f6d-1ae1-42d6-957a-9842d5538477 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:41.253648 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-03b37f6d-1ae1-42d6-957a-9842d5538477 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:41.260632 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-03b37f6d-1ae1-42d6-957a-9842d5538477 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:41.261145 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-03b37f6d-1ae1-42d6-957a-9842d5538477 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:41.261577 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-03b37f6d-1ae1-42d6-957a-9842d5538477 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:41.262261 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-03b37f6d-1ae1-42d6-957a-9842d5538477 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:41.262706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-03b37f6d-1ae1-42d6-957a-9842d5538477 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:41.263122 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-03b37f6d-1ae1-42d6-957a-9842d5538477 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:41.407657 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-03b37f6d-1ae1-42d6-957a-9842d5538477 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:41.416064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-03b37f6d-1ae1-42d6-957a-9842d5538477 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1710 microversion: 2.1 time: 0.167014 Aug 19 16:35:41.416634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 303/595] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:41 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1710 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:41.431476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7928a4a4-53ee-444a-b7f1-35b571af4636 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:41.432076 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7928a4a4-53ee-444a-b7f1-35b571af4636 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:41.438253 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7928a4a4-53ee-444a-b7f1-35b571af4636 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:41.438735 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7928a4a4-53ee-444a-b7f1-35b571af4636 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:41.439166 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7928a4a4-53ee-444a-b7f1-35b571af4636 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:41.439857 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7928a4a4-53ee-444a-b7f1-35b571af4636 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:41.440301 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7928a4a4-53ee-444a-b7f1-35b571af4636 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:41.440715 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7928a4a4-53ee-444a-b7f1-35b571af4636 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:41.578986 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7928a4a4-53ee-444a-b7f1-35b571af4636 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:41.588429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7928a4a4-53ee-444a-b7f1-35b571af4636 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:41.590018 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7928a4a4-53ee-444a-b7f1-35b571af4636 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:41.591191 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7928a4a4-53ee-444a-b7f1-35b571af4636 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.163621 Aug 19 16:35:41.591756 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 293/596] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:41 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:41.814411 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-5eff1132-7395-47c0-8d55-0826122d7dbb tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:41.814994 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-5eff1132-7395-47c0-8d55-0826122d7dbb tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:41.821484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5eff1132-7395-47c0-8d55-0826122d7dbb tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:41.821954 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5eff1132-7395-47c0-8d55-0826122d7dbb tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:41.822377 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5eff1132-7395-47c0-8d55-0826122d7dbb tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:41.823068 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5eff1132-7395-47c0-8d55-0826122d7dbb tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:41.823514 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5eff1132-7395-47c0-8d55-0826122d7dbb tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:41.823932 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5eff1132-7395-47c0-8d55-0826122d7dbb tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:41.965343 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5eff1132-7395-47c0-8d55-0826122d7dbb tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:41.974924 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-5eff1132-7395-47c0-8d55-0826122d7dbb tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.164489 Aug 19 16:35:41.975501 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 304/597] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:41 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:42.115722 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-90d6a670-7ad2-40d3-8a99-7a4c33db17bf tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:42.116343 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-90d6a670-7ad2-40d3-8a99-7a4c33db17bf tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:42.122834 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-90d6a670-7ad2-40d3-8a99-7a4c33db17bf tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:42.123322 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-90d6a670-7ad2-40d3-8a99-7a4c33db17bf tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:42.123758 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-90d6a670-7ad2-40d3-8a99-7a4c33db17bf tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:42.124460 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-90d6a670-7ad2-40d3-8a99-7a4c33db17bf tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:42.124949 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-90d6a670-7ad2-40d3-8a99-7a4c33db17bf tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:42.125380 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-90d6a670-7ad2-40d3-8a99-7a4c33db17bf tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:42.258676 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-90d6a670-7ad2-40d3-8a99-7a4c33db17bf tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:42.266591 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-90d6a670-7ad2-40d3-8a99-7a4c33db17bf tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.155326 Aug 19 16:35:42.267359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 294/598] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:42 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:42.438192 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f9d4af1b-5d40-452b-8e30-33989c70a267 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:42.438845 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f9d4af1b-5d40-452b-8e30-33989c70a267 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:42.445231 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f9d4af1b-5d40-452b-8e30-33989c70a267 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:42.445737 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f9d4af1b-5d40-452b-8e30-33989c70a267 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:42.446172 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f9d4af1b-5d40-452b-8e30-33989c70a267 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:42.446878 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f9d4af1b-5d40-452b-8e30-33989c70a267 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:42.447331 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f9d4af1b-5d40-452b-8e30-33989c70a267 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:42.447751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f9d4af1b-5d40-452b-8e30-33989c70a267 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:42.580850 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f9d4af1b-5d40-452b-8e30-33989c70a267 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:42.589813 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f9d4af1b-5d40-452b-8e30-33989c70a267 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1710 microversion: 2.1 time: 0.155447 Aug 19 16:35:42.590368 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 305/599] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:42 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:42.615110 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7dbaabd2-163e-4b40-90f6-e7b1a2ce3d77 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:42.615722 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7dbaabd2-163e-4b40-90f6-e7b1a2ce3d77 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:42.621596 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7dbaabd2-163e-4b40-90f6-e7b1a2ce3d77 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:42.622075 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7dbaabd2-163e-4b40-90f6-e7b1a2ce3d77 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:42.622504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7dbaabd2-163e-4b40-90f6-e7b1a2ce3d77 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:42.623184 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7dbaabd2-163e-4b40-90f6-e7b1a2ce3d77 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:42.623635 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7dbaabd2-163e-4b40-90f6-e7b1a2ce3d77 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:42.624056 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7dbaabd2-163e-4b40-90f6-e7b1a2ce3d77 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:42.744928 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d880918b-5425-4559-8801-8a653416ac45 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc04bb90-55ba-4333-bf62-023881ec57ee"}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:35:42.747471 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d880918b-5425-4559-8801-8a653416ac45 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:42.753208 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d880918b-5425-4559-8801-8a653416ac45 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:42.754171 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d880918b-5425-4559-8801-8a653416ac45 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:42.754894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d880918b-5425-4559-8801-8a653416ac45 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:42.755624 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d880918b-5425-4559-8801-8a653416ac45 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:42.756078 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d880918b-5425-4559-8801-8a653416ac45 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:42.756500 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d880918b-5425-4559-8801-8a653416ac45 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:42.757785 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7dbaabd2-163e-4b40-90f6-e7b1a2ce3d77 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:42.768002 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7dbaabd2-163e-4b40-90f6-e7b1a2ce3d77 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:42.770606 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7dbaabd2-163e-4b40-90f6-e7b1a2ce3d77 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:42.771997 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7dbaabd2-163e-4b40-90f6-e7b1a2ce3d77 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.161138 Aug 19 16:35:42.789193 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 295/600] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:42 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:42.996632 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-6e23e56c-a2c7-407a-b8fe-090706caf00a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:42.997259 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-6e23e56c-a2c7-407a-b8fe-090706caf00a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:43.003177 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6e23e56c-a2c7-407a-b8fe-090706caf00a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:43.003645 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6e23e56c-a2c7-407a-b8fe-090706caf00a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:43.004869 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6e23e56c-a2c7-407a-b8fe-090706caf00a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:43.005543 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6e23e56c-a2c7-407a-b8fe-090706caf00a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:43.005995 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6e23e56c-a2c7-407a-b8fe-090706caf00a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:43.006412 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6e23e56c-a2c7-407a-b8fe-090706caf00a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:43.133916 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-6e23e56c-a2c7-407a-b8fe-090706caf00a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:43.141526 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-6e23e56c-a2c7-407a-b8fe-090706caf00a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.148733 Aug 19 16:35:43.142085 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 296/601] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:42 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:43.288084 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c11c85f6-89cf-4477-b755-c528f2b6ad6c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:43.288790 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-c11c85f6-89cf-4477-b755-c528f2b6ad6c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:43.295108 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c11c85f6-89cf-4477-b755-c528f2b6ad6c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:43.295796 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c11c85f6-89cf-4477-b755-c528f2b6ad6c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:43.296226 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c11c85f6-89cf-4477-b755-c528f2b6ad6c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:43.297121 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c11c85f6-89cf-4477-b755-c528f2b6ad6c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:43.297563 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c11c85f6-89cf-4477-b755-c528f2b6ad6c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:43.297979 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c11c85f6-89cf-4477-b755-c528f2b6ad6c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:43.564187 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c11c85f6-89cf-4477-b755-c528f2b6ad6c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:43.572472 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c11c85f6-89cf-4477-b755-c528f2b6ad6c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.288634 Aug 19 16:35:43.586469 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 297/602] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:43 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:43.611064 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-757a94b4-47a9-4c42-b576-53007d72c1f6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:43.611762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-757a94b4-47a9-4c42-b576-53007d72c1f6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:43.618917 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-757a94b4-47a9-4c42-b576-53007d72c1f6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:43.619487 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-757a94b4-47a9-4c42-b576-53007d72c1f6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:43.620019 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-757a94b4-47a9-4c42-b576-53007d72c1f6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:43.620814 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-757a94b4-47a9-4c42-b576-53007d72c1f6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:43.621336 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-757a94b4-47a9-4c42-b576-53007d72c1f6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:43.621826 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-757a94b4-47a9-4c42-b576-53007d72c1f6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:43.865421 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-757a94b4-47a9-4c42-b576-53007d72c1f6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:43.873679 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-757a94b4-47a9-4c42-b576-53007d72c1f6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1710 microversion: 2.1 time: 0.266877 Aug 19 16:35:43.874496 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 298/603] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:43 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1710 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:43.878743 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-935c3c37-a8cf-4e71-b230-36057033135e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:43.879518 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-935c3c37-a8cf-4e71-b230-36057033135e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:43.885571 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-935c3c37-a8cf-4e71-b230-36057033135e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:43.886041 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-935c3c37-a8cf-4e71-b230-36057033135e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:43.886484 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-935c3c37-a8cf-4e71-b230-36057033135e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:43.887486 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-935c3c37-a8cf-4e71-b230-36057033135e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:43.887611 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-935c3c37-a8cf-4e71-b230-36057033135e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:43.888016 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-935c3c37-a8cf-4e71-b230-36057033135e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:44.092645 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-935c3c37-a8cf-4e71-b230-36057033135e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:44.101765 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-935c3c37-a8cf-4e71-b230-36057033135e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:44.103277 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-935c3c37-a8cf-4e71-b230-36057033135e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:44.104420 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-935c3c37-a8cf-4e71-b230-36057033135e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.229270 Aug 19 16:35:44.104999 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 299/604] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:43 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:44.109213 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-baf37ba6-61f9-4bf4-a313-14d18da7ae09 req-ef03b1f3-d7d0-4dcf-8276-e1d332e7204f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c18cbc3d-cc71-4f92-b80f-8d75547d8e34", "tag": "726cac17-7761-4611-aa5f-2dce23965fa9"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:35:44.118138 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-baf37ba6-61f9-4bf4-a313-14d18da7ae09 req-ef03b1f3-d7d0-4dcf-8276-e1d332e7204f service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:44.118605 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-baf37ba6-61f9-4bf4-a313-14d18da7ae09 req-ef03b1f3-d7d0-4dcf-8276-e1d332e7204f service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:44.119025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-baf37ba6-61f9-4bf4-a313-14d18da7ae09 req-ef03b1f3-d7d0-4dcf-8276-e1d332e7204f service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:44.130015 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-baf37ba6-61f9-4bf4-a313-14d18da7ae09 req-ef03b1f3-d7d0-4dcf-8276-e1d332e7204f service nova] Creating event network-changed:726cac17-7761-4611-aa5f-2dce23965fa9 for instance c18cbc3d-cc71-4f92-b80f-8d75547d8e34 on hv-cinder-83124 Aug 19 16:35:44.134716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-baf37ba6-61f9-4bf4-a313-14d18da7ae09 req-ef03b1f3-d7d0-4dcf-8276-e1d332e7204f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028642 Aug 19 16:35:44.135321 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 300/605] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:35:44.139962 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-ac737504-f1d6-4768-bb00-d2a7bf7ea72c req-59860031-6f7d-4f48-8088-7860f22c609a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4034526-7330-4541-a2cb-d646a572d9d8", "tag": "498a3f32-b577-44b6-8701-625d4a4962ec"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:35:44.149533 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-ac737504-f1d6-4768-bb00-d2a7bf7ea72c req-59860031-6f7d-4f48-8088-7860f22c609a service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:44.149992 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-ac737504-f1d6-4768-bb00-d2a7bf7ea72c req-59860031-6f7d-4f48-8088-7860f22c609a service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:44.150409 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-ac737504-f1d6-4768-bb00-d2a7bf7ea72c req-59860031-6f7d-4f48-8088-7860f22c609a service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:44.161256 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-ac737504-f1d6-4768-bb00-d2a7bf7ea72c req-59860031-6f7d-4f48-8088-7860f22c609a service nova] Creating event network-changed:498a3f32-b577-44b6-8701-625d4a4962ec for instance d4034526-7330-4541-a2cb-d646a572d9d8 on hv-cinder-83124 Aug 19 16:35:44.165919 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-ac737504-f1d6-4768-bb00-d2a7bf7ea72c req-59860031-6f7d-4f48-8088-7860f22c609a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029419 Aug 19 16:35:44.166498 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 301/606] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:35:44.171330 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-75d5a6df-c0da-49ca-9884-f1e80b2b3611 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:44.172050 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-75d5a6df-c0da-49ca-9884-f1e80b2b3611 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:44.178867 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-75d5a6df-c0da-49ca-9884-f1e80b2b3611 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:44.179339 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-75d5a6df-c0da-49ca-9884-f1e80b2b3611 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:44.179773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-75d5a6df-c0da-49ca-9884-f1e80b2b3611 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:44.180446 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-75d5a6df-c0da-49ca-9884-f1e80b2b3611 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:44.180933 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-75d5a6df-c0da-49ca-9884-f1e80b2b3611 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:44.181354 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-75d5a6df-c0da-49ca-9884-f1e80b2b3611 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:44.321826 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-75d5a6df-c0da-49ca-9884-f1e80b2b3611 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:44.329717 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-75d5a6df-c0da-49ca-9884-f1e80b2b3611 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.162160 Aug 19 16:35:44.330276 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 302/607] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:44 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:44.579802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d880918b-5425-4559-8801-8a653416ac45 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "POST /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.838607 Aug 19 16:35:44.580783 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 306/608] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Aug 19 16:35:42 2022] POST /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/os-volume_attachments => generated 194 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:35:44.595725 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c8df2d18-a233-4346-9fb6-11283a4c827e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:44.596457 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-c8df2d18-a233-4346-9fb6-11283a4c827e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:44.606386 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c8df2d18-a233-4346-9fb6-11283a4c827e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:44.607053 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c8df2d18-a233-4346-9fb6-11283a4c827e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:44.607556 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c8df2d18-a233-4346-9fb6-11283a4c827e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:44.609398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c8df2d18-a233-4346-9fb6-11283a4c827e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:44.609932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c8df2d18-a233-4346-9fb6-11283a4c827e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:44.610425 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c8df2d18-a233-4346-9fb6-11283a4c827e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:44.826056 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c8df2d18-a233-4346-9fb6-11283a4c827e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:44.835566 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c8df2d18-a233-4346-9fb6-11283a4c827e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.245663 Aug 19 16:35:44.836207 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 303/609] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:44 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:44.898062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ac88494c-80df-42f2-b55c-e23080ccfa48 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:44.900695 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ac88494c-80df-42f2-b55c-e23080ccfa48 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:44.907153 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ac88494c-80df-42f2-b55c-e23080ccfa48 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:44.907982 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ac88494c-80df-42f2-b55c-e23080ccfa48 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:44.908693 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ac88494c-80df-42f2-b55c-e23080ccfa48 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:44.909849 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ac88494c-80df-42f2-b55c-e23080ccfa48 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:44.910438 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ac88494c-80df-42f2-b55c-e23080ccfa48 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:44.911299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ac88494c-80df-42f2-b55c-e23080ccfa48 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:45.073404 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ac88494c-80df-42f2-b55c-e23080ccfa48 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:45.082457 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ac88494c-80df-42f2-b55c-e23080ccfa48 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1710 microversion: 2.1 time: 0.190636 Aug 19 16:35:45.083045 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 307/610] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:44 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1710 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:45.127601 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ee8d57f8-3e9b-4e8e-8dd9-bd9e77b7538b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:45.128208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ee8d57f8-3e9b-4e8e-8dd9-bd9e77b7538b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:45.136129 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ee8d57f8-3e9b-4e8e-8dd9-bd9e77b7538b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:45.136810 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ee8d57f8-3e9b-4e8e-8dd9-bd9e77b7538b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:45.137043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ee8d57f8-3e9b-4e8e-8dd9-bd9e77b7538b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:45.137729 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ee8d57f8-3e9b-4e8e-8dd9-bd9e77b7538b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:45.138172 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ee8d57f8-3e9b-4e8e-8dd9-bd9e77b7538b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:45.138812 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ee8d57f8-3e9b-4e8e-8dd9-bd9e77b7538b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:45.334779 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ee8d57f8-3e9b-4e8e-8dd9-bd9e77b7538b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:45.343301 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ee8d57f8-3e9b-4e8e-8dd9-bd9e77b7538b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:45.344795 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ee8d57f8-3e9b-4e8e-8dd9-bd9e77b7538b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:45.345997 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ee8d57f8-3e9b-4e8e-8dd9-bd9e77b7538b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.222464 Aug 19 16:35:45.346722 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 304/611] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:45 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:45.351027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4f557a2d-61a3-4d4a-a5ef-5099e9336eac tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:45.351636 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-4f557a2d-61a3-4d4a-a5ef-5099e9336eac tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:45.357928 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4f557a2d-61a3-4d4a-a5ef-5099e9336eac tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:45.358422 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4f557a2d-61a3-4d4a-a5ef-5099e9336eac tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:45.358842 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4f557a2d-61a3-4d4a-a5ef-5099e9336eac tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:45.359522 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4f557a2d-61a3-4d4a-a5ef-5099e9336eac tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:45.359972 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4f557a2d-61a3-4d4a-a5ef-5099e9336eac tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:45.360392 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4f557a2d-61a3-4d4a-a5ef-5099e9336eac tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:45.490087 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-4f557a2d-61a3-4d4a-a5ef-5099e9336eac tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:45.497913 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4f557a2d-61a3-4d4a-a5ef-5099e9336eac tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.151571 Aug 19 16:35:45.498672 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 308/612] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:45 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:45.857048 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a1e63316-aa74-4cd4-a68e-531664f5a5e2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:45.857777 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a1e63316-aa74-4cd4-a68e-531664f5a5e2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:45.864077 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a1e63316-aa74-4cd4-a68e-531664f5a5e2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:45.864729 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a1e63316-aa74-4cd4-a68e-531664f5a5e2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:45.865244 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a1e63316-aa74-4cd4-a68e-531664f5a5e2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:45.865973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a1e63316-aa74-4cd4-a68e-531664f5a5e2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:45.866464 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a1e63316-aa74-4cd4-a68e-531664f5a5e2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:45.866923 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a1e63316-aa74-4cd4-a68e-531664f5a5e2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:45.994711 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a1e63316-aa74-4cd4-a68e-531664f5a5e2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:46.002311 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a1e63316-aa74-4cd4-a68e-531664f5a5e2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.149191 Aug 19 16:35:46.002859 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 305/613] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:45 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:46.105010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6fe79da5-7abb-47d7-9761-50caaae19829 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:46.105629 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6fe79da5-7abb-47d7-9761-50caaae19829 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:46.111939 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6fe79da5-7abb-47d7-9761-50caaae19829 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:46.112422 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6fe79da5-7abb-47d7-9761-50caaae19829 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:46.113370 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6fe79da5-7abb-47d7-9761-50caaae19829 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:46.114142 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6fe79da5-7abb-47d7-9761-50caaae19829 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:46.114594 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6fe79da5-7abb-47d7-9761-50caaae19829 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:46.115020 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6fe79da5-7abb-47d7-9761-50caaae19829 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:46.248080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6fe79da5-7abb-47d7-9761-50caaae19829 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:46.257311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6fe79da5-7abb-47d7-9761-50caaae19829 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1714 microversion: 2.1 time: 0.156883 Aug 19 16:35:46.257884 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 309/614] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:46 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:46.369841 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-be09998d-0156-4e29-b6d8-ccae8ae1522f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:46.370457 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-be09998d-0156-4e29-b6d8-ccae8ae1522f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:46.377482 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-be09998d-0156-4e29-b6d8-ccae8ae1522f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:46.378202 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-be09998d-0156-4e29-b6d8-ccae8ae1522f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:46.380226 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-be09998d-0156-4e29-b6d8-ccae8ae1522f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:46.381176 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-be09998d-0156-4e29-b6d8-ccae8ae1522f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:46.381790 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-be09998d-0156-4e29-b6d8-ccae8ae1522f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:46.382271 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-be09998d-0156-4e29-b6d8-ccae8ae1522f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:46.525042 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6e797bcd-2ad4-4974-97ca-349f801daf44 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:46.526155 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6e797bcd-2ad4-4974-97ca-349f801daf44 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:46.534161 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e797bcd-2ad4-4974-97ca-349f801daf44 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:46.535530 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e797bcd-2ad4-4974-97ca-349f801daf44 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:46.536196 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e797bcd-2ad4-4974-97ca-349f801daf44 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:46.537187 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e797bcd-2ad4-4974-97ca-349f801daf44 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:46.538661 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e797bcd-2ad4-4974-97ca-349f801daf44 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:46.540432 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e797bcd-2ad4-4974-97ca-349f801daf44 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:46.672975 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-be09998d-0156-4e29-b6d8-ccae8ae1522f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:46.685816 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-be09998d-0156-4e29-b6d8-ccae8ae1522f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:46.687348 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-be09998d-0156-4e29-b6d8-ccae8ae1522f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:46.688925 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-be09998d-0156-4e29-b6d8-ccae8ae1522f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.323671 Aug 19 16:35:46.689485 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 306/615] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:46 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:46.713832 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6e797bcd-2ad4-4974-97ca-349f801daf44 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:46.721470 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6e797bcd-2ad4-4974-97ca-349f801daf44 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.202724 Aug 19 16:35:46.722029 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 310/616] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:46 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:47.022945 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-35782e0b-5f15-46cf-aba9-afe3baaf0115 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:47.023555 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-35782e0b-5f15-46cf-aba9-afe3baaf0115 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:47.029439 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35782e0b-5f15-46cf-aba9-afe3baaf0115 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:47.029917 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35782e0b-5f15-46cf-aba9-afe3baaf0115 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:47.030358 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35782e0b-5f15-46cf-aba9-afe3baaf0115 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:47.031035 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35782e0b-5f15-46cf-aba9-afe3baaf0115 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:47.031484 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35782e0b-5f15-46cf-aba9-afe3baaf0115 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:47.031902 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35782e0b-5f15-46cf-aba9-afe3baaf0115 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:47.165187 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-35782e0b-5f15-46cf-aba9-afe3baaf0115 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:47.172704 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-35782e0b-5f15-46cf-aba9-afe3baaf0115 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.153717 Aug 19 16:35:47.173329 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 307/617] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:47 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:47.713141 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1093ae8d-adff-4f0b-bb18-41802f6f2336 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:47.713910 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-1093ae8d-adff-4f0b-bb18-41802f6f2336 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:47.720178 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1093ae8d-adff-4f0b-bb18-41802f6f2336 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:47.720652 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1093ae8d-adff-4f0b-bb18-41802f6f2336 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:47.721112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1093ae8d-adff-4f0b-bb18-41802f6f2336 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:47.721786 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1093ae8d-adff-4f0b-bb18-41802f6f2336 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:47.722231 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1093ae8d-adff-4f0b-bb18-41802f6f2336 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:47.722650 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1093ae8d-adff-4f0b-bb18-41802f6f2336 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:47.742429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-0133f67d-7e60-43a2-adc9-1454d2903958 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:47.743072 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-0133f67d-7e60-43a2-adc9-1454d2903958 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:47.749477 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0133f67d-7e60-43a2-adc9-1454d2903958 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:47.749966 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0133f67d-7e60-43a2-adc9-1454d2903958 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:47.750446 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0133f67d-7e60-43a2-adc9-1454d2903958 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:47.751138 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0133f67d-7e60-43a2-adc9-1454d2903958 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:47.751593 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0133f67d-7e60-43a2-adc9-1454d2903958 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:47.752019 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0133f67d-7e60-43a2-adc9-1454d2903958 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:47.861353 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1093ae8d-adff-4f0b-bb18-41802f6f2336 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:47.870429 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1093ae8d-adff-4f0b-bb18-41802f6f2336 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:47.871929 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1093ae8d-adff-4f0b-bb18-41802f6f2336 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:47.873118 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-1093ae8d-adff-4f0b-bb18-41802f6f2336 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.163828 Aug 19 16:35:47.873674 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 311/618] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:47 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:47.896513 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-0133f67d-7e60-43a2-adc9-1454d2903958 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:47.904029 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-0133f67d-7e60-43a2-adc9-1454d2903958 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.165595 Aug 19 16:35:47.904593 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 308/619] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:47 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:48.195493 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f7bfdb35-21be-4b23-b094-76ca735e92a2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:48.196110 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f7bfdb35-21be-4b23-b094-76ca735e92a2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:48.202324 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f7bfdb35-21be-4b23-b094-76ca735e92a2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:48.202805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f7bfdb35-21be-4b23-b094-76ca735e92a2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:48.203240 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f7bfdb35-21be-4b23-b094-76ca735e92a2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:48.203927 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f7bfdb35-21be-4b23-b094-76ca735e92a2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:48.204379 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f7bfdb35-21be-4b23-b094-76ca735e92a2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:48.204834 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f7bfdb35-21be-4b23-b094-76ca735e92a2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:48.222017 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:35:48.333643 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f7bfdb35-21be-4b23-b094-76ca735e92a2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:48.341245 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f7bfdb35-21be-4b23-b094-76ca735e92a2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.150118 Aug 19 16:35:48.345719 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 312/620] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:48 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:48.861119 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-0b9d0b18-c358-4cf6-8097-79b043828197 req-3f3f2e5a-e2ce-42d4-be4e-d5848284faef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894cc1e2-8a17-4de0-8127-b929095837d8", "name": "network-vif-plugged", "status": "completed", "tag": "72e0a5f4-4545-47a6-8d9a-ae53acb35877"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:35:48.872637 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-0b9d0b18-c358-4cf6-8097-79b043828197 req-3f3f2e5a-e2ce-42d4-be4e-d5848284faef service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:48.873195 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-0b9d0b18-c358-4cf6-8097-79b043828197 req-3f3f2e5a-e2ce-42d4-be4e-d5848284faef service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:48.873756 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-0b9d0b18-c358-4cf6-8097-79b043828197 req-3f3f2e5a-e2ce-42d4-be4e-d5848284faef service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:48.891733 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-0b9d0b18-c358-4cf6-8097-79b043828197 req-3f3f2e5a-e2ce-42d4-be4e-d5848284faef service nova] Creating event network-vif-plugged:72e0a5f4-4545-47a6-8d9a-ae53acb35877 for instance 894cc1e2-8a17-4de0-8127-b929095837d8 on hv-cinder-83124 Aug 19 16:35:48.893423 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-0b9d0b18-c358-4cf6-8097-79b043828197 req-3f3f2e5a-e2ce-42d4-be4e-d5848284faef service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035046 Aug 19 16:35:48.893551 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 309/621] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:35:48.897682 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a2a9e66e-2b77-45d3-a63b-a39c4ab9b94b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:48.898297 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a2a9e66e-2b77-45d3-a63b-a39c4ab9b94b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:48.905104 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a2a9e66e-2b77-45d3-a63b-a39c4ab9b94b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:48.905611 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a2a9e66e-2b77-45d3-a63b-a39c4ab9b94b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:48.906676 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a2a9e66e-2b77-45d3-a63b-a39c4ab9b94b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:48.907435 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a2a9e66e-2b77-45d3-a63b-a39c4ab9b94b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:48.907815 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a2a9e66e-2b77-45d3-a63b-a39c4ab9b94b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:48.908240 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a2a9e66e-2b77-45d3-a63b-a39c4ab9b94b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:48.925341 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-dfbe7f43-70d4-495f-9464-e4bfbc2e4e43 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:48.926538 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-dfbe7f43-70d4-495f-9464-e4bfbc2e4e43 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:48.932846 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dfbe7f43-70d4-495f-9464-e4bfbc2e4e43 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:48.933323 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dfbe7f43-70d4-495f-9464-e4bfbc2e4e43 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:48.933835 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dfbe7f43-70d4-495f-9464-e4bfbc2e4e43 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:48.934484 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dfbe7f43-70d4-495f-9464-e4bfbc2e4e43 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:48.934937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dfbe7f43-70d4-495f-9464-e4bfbc2e4e43 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:48.935504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dfbe7f43-70d4-495f-9464-e4bfbc2e4e43 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:49.050851 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a2a9e66e-2b77-45d3-a63b-a39c4ab9b94b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:49.059955 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a2a9e66e-2b77-45d3-a63b-a39c4ab9b94b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:49.061485 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a2a9e66e-2b77-45d3-a63b-a39c4ab9b94b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:49.062635 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a2a9e66e-2b77-45d3-a63b-a39c4ab9b94b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.169498 Aug 19 16:35:49.063191 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 313/622] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:48 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:49.072973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-dfbe7f43-70d4-495f-9464-e4bfbc2e4e43 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:49.080896 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-dfbe7f43-70d4-495f-9464-e4bfbc2e4e43 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.159925 Aug 19 16:35:49.081448 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 310/623] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:48 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:49.363075 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1bd0fa64-2ed9-4c55-b993-95d4b9524c8f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:49.364366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-1bd0fa64-2ed9-4c55-b993-95d4b9524c8f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:49.370377 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1bd0fa64-2ed9-4c55-b993-95d4b9524c8f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:49.370861 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1bd0fa64-2ed9-4c55-b993-95d4b9524c8f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:49.371299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1bd0fa64-2ed9-4c55-b993-95d4b9524c8f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:49.371991 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1bd0fa64-2ed9-4c55-b993-95d4b9524c8f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:49.372448 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1bd0fa64-2ed9-4c55-b993-95d4b9524c8f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:49.372902 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1bd0fa64-2ed9-4c55-b993-95d4b9524c8f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:49.496295 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1bd0fa64-2ed9-4c55-b993-95d4b9524c8f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:49.503804 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-1bd0fa64-2ed9-4c55-b993-95d4b9524c8f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.144572 Aug 19 16:35:49.504494 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 314/624] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:49 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:50.086563 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e2e8f229-e2e3-45b9-a5cc-b4ef2726a6cf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:50.087197 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-e2e8f229-e2e3-45b9-a5cc-b4ef2726a6cf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:50.093527 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e2e8f229-e2e3-45b9-a5cc-b4ef2726a6cf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:50.094000 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e2e8f229-e2e3-45b9-a5cc-b4ef2726a6cf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:50.094426 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e2e8f229-e2e3-45b9-a5cc-b4ef2726a6cf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:50.095128 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e2e8f229-e2e3-45b9-a5cc-b4ef2726a6cf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:50.095625 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e2e8f229-e2e3-45b9-a5cc-b4ef2726a6cf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:50.096047 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e2e8f229-e2e3-45b9-a5cc-b4ef2726a6cf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:50.100232 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=100 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:35:50.101422 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ef3f94f0-ead0-4929-b1b3-44ce642e71ba tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:50.102184 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ef3f94f0-ead0-4929-b1b3-44ce642e71ba tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:50.108493 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ef3f94f0-ead0-4929-b1b3-44ce642e71ba tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:50.109008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ef3f94f0-ead0-4929-b1b3-44ce642e71ba tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:50.109445 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ef3f94f0-ead0-4929-b1b3-44ce642e71ba tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:50.110137 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ef3f94f0-ead0-4929-b1b3-44ce642e71ba tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:50.110590 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ef3f94f0-ead0-4929-b1b3-44ce642e71ba tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:50.111020 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ef3f94f0-ead0-4929-b1b3-44ce642e71ba tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:50.231873 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e2e8f229-e2e3-45b9-a5cc-b4ef2726a6cf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:50.240664 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e2e8f229-e2e3-45b9-a5cc-b4ef2726a6cf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:50.242190 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e2e8f229-e2e3-45b9-a5cc-b4ef2726a6cf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:50.243333 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e2e8f229-e2e3-45b9-a5cc-b4ef2726a6cf tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.161363 Aug 19 16:35:50.243887 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 311/625] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:50 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:50.244017 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ef3f94f0-ead0-4929-b1b3-44ce642e71ba tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:50.251743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ef3f94f0-ead0-4929-b1b3-44ce642e71ba tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.154291 Aug 19 16:35:50.252368 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 315/626] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:50 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:50.524232 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-3dbff3b1-15a0-4fb7-9901-32fd71f86410 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:50.524957 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-3dbff3b1-15a0-4fb7-9901-32fd71f86410 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:50.531345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3dbff3b1-15a0-4fb7-9901-32fd71f86410 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:50.531920 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3dbff3b1-15a0-4fb7-9901-32fd71f86410 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:50.532357 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3dbff3b1-15a0-4fb7-9901-32fd71f86410 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:50.533079 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3dbff3b1-15a0-4fb7-9901-32fd71f86410 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:50.533529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3dbff3b1-15a0-4fb7-9901-32fd71f86410 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:50.534012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3dbff3b1-15a0-4fb7-9901-32fd71f86410 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:50.669756 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-3dbff3b1-15a0-4fb7-9901-32fd71f86410 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:50.677360 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-3dbff3b1-15a0-4fb7-9901-32fd71f86410 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.157698 Aug 19 16:35:50.677930 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 312/627] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:50 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:51.266432 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-28e8f96f-182f-4401-bf03-99e96687e5e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:51.267042 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-28e8f96f-182f-4401-bf03-99e96687e5e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:51.273126 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2c78ac47-d2e7-4dbd-bf5b-0f73f26bd706 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:51.273733 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2c78ac47-d2e7-4dbd-bf5b-0f73f26bd706 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:51.273856 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-28e8f96f-182f-4401-bf03-99e96687e5e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:51.274306 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-28e8f96f-182f-4401-bf03-99e96687e5e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:51.274776 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-28e8f96f-182f-4401-bf03-99e96687e5e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:51.275471 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-28e8f96f-182f-4401-bf03-99e96687e5e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:51.275925 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-28e8f96f-182f-4401-bf03-99e96687e5e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:51.276348 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-28e8f96f-182f-4401-bf03-99e96687e5e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:51.280076 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2c78ac47-d2e7-4dbd-bf5b-0f73f26bd706 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:51.280578 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2c78ac47-d2e7-4dbd-bf5b-0f73f26bd706 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:51.281044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2c78ac47-d2e7-4dbd-bf5b-0f73f26bd706 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:51.281728 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2c78ac47-d2e7-4dbd-bf5b-0f73f26bd706 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:51.282175 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2c78ac47-d2e7-4dbd-bf5b-0f73f26bd706 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:51.282593 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2c78ac47-d2e7-4dbd-bf5b-0f73f26bd706 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:51.405722 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-28e8f96f-182f-4401-bf03-99e96687e5e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:51.416714 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-28e8f96f-182f-4401-bf03-99e96687e5e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:51.416968 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2c78ac47-d2e7-4dbd-bf5b-0f73f26bd706 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:51.418224 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-28e8f96f-182f-4401-bf03-99e96687e5e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:51.419368 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-28e8f96f-182f-4401-bf03-99e96687e5e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.156881 Aug 19 16:35:51.419947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 316/628] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:51 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:51.424917 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2c78ac47-d2e7-4dbd-bf5b-0f73f26bd706 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.155685 Aug 19 16:35:51.425552 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 313/629] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:51 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:51.697477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-173c6e49-2378-4b61-996e-1c5d873cd906 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:51.698085 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-173c6e49-2378-4b61-996e-1c5d873cd906 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:51.704091 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-173c6e49-2378-4b61-996e-1c5d873cd906 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:51.704571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-173c6e49-2378-4b61-996e-1c5d873cd906 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:51.705034 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-173c6e49-2378-4b61-996e-1c5d873cd906 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:51.705716 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-173c6e49-2378-4b61-996e-1c5d873cd906 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:51.706168 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-173c6e49-2378-4b61-996e-1c5d873cd906 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:51.706590 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-173c6e49-2378-4b61-996e-1c5d873cd906 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:51.836215 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-173c6e49-2378-4b61-996e-1c5d873cd906 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:51.843744 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-173c6e49-2378-4b61-996e-1c5d873cd906 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.150066 Aug 19 16:35:51.844303 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 317/630] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:51 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:52.442996 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-371cb630-b0f9-4ac1-a87d-bce0c3b24e41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:52.443526 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-371cb630-b0f9-4ac1-a87d-bce0c3b24e41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:52.445459 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8582284c-d196-4297-8edf-50dee69e368d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:52.446072 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8582284c-d196-4297-8edf-50dee69e368d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:52.450016 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-371cb630-b0f9-4ac1-a87d-bce0c3b24e41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:52.450498 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-371cb630-b0f9-4ac1-a87d-bce0c3b24e41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:52.450932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-371cb630-b0f9-4ac1-a87d-bce0c3b24e41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:52.451875 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-371cb630-b0f9-4ac1-a87d-bce0c3b24e41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:52.452322 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-371cb630-b0f9-4ac1-a87d-bce0c3b24e41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:52.452554 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8582284c-d196-4297-8edf-50dee69e368d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:52.452742 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-371cb630-b0f9-4ac1-a87d-bce0c3b24e41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:52.453067 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8582284c-d196-4297-8edf-50dee69e368d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:52.453499 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8582284c-d196-4297-8edf-50dee69e368d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:52.454186 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8582284c-d196-4297-8edf-50dee69e368d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:52.454642 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8582284c-d196-4297-8edf-50dee69e368d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:52.455071 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8582284c-d196-4297-8edf-50dee69e368d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:52.582980 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-371cb630-b0f9-4ac1-a87d-bce0c3b24e41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:52.583615 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-8582284c-d196-4297-8edf-50dee69e368d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:52.591551 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8582284c-d196-4297-8edf-50dee69e368d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.149800 Aug 19 16:35:52.592122 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 318/631] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:52 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:52.592429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-371cb630-b0f9-4ac1-a87d-bce0c3b24e41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:52.593950 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-371cb630-b0f9-4ac1-a87d-bce0c3b24e41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:52.595091 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-371cb630-b0f9-4ac1-a87d-bce0c3b24e41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.156396 Aug 19 16:35:52.595877 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 314/632] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:52 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:52.865266 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1ef45927-1f7f-4e4e-9349-e6564ccbf711 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:52.865879 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-1ef45927-1f7f-4e4e-9349-e6564ccbf711 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:52.871747 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1ef45927-1f7f-4e4e-9349-e6564ccbf711 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:52.872221 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1ef45927-1f7f-4e4e-9349-e6564ccbf711 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:52.872673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1ef45927-1f7f-4e4e-9349-e6564ccbf711 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:52.873376 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1ef45927-1f7f-4e4e-9349-e6564ccbf711 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:52.873826 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1ef45927-1f7f-4e4e-9349-e6564ccbf711 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:52.874248 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1ef45927-1f7f-4e4e-9349-e6564ccbf711 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:53.004718 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1ef45927-1f7f-4e4e-9349-e6564ccbf711 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:53.012538 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-1ef45927-1f7f-4e4e-9349-e6564ccbf711 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.151289 Aug 19 16:35:53.013139 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 319/633] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:52 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:53.549822 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-31f31619-ef0e-4b94-9d51-f94252349528 req-218c8fd7-6feb-498b-9268-efee11392d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c18cbc3d-cc71-4f92-b80f-8d75547d8e34", "name": "network-vif-plugged", "status": "completed", "tag": "726cac17-7761-4611-aa5f-2dce23965fa9"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:35:53.560115 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-31f31619-ef0e-4b94-9d51-f94252349528 req-218c8fd7-6feb-498b-9268-efee11392d95 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:53.560595 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-31f31619-ef0e-4b94-9d51-f94252349528 req-218c8fd7-6feb-498b-9268-efee11392d95 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:53.561057 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-31f31619-ef0e-4b94-9d51-f94252349528 req-218c8fd7-6feb-498b-9268-efee11392d95 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:53.572916 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-31f31619-ef0e-4b94-9d51-f94252349528 req-218c8fd7-6feb-498b-9268-efee11392d95 service nova] Creating event network-vif-plugged:726cac17-7761-4611-aa5f-2dce23965fa9 for instance c18cbc3d-cc71-4f92-b80f-8d75547d8e34 on hv-cinder-83124 Aug 19 16:35:53.578027 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-31f31619-ef0e-4b94-9d51-f94252349528 req-218c8fd7-6feb-498b-9268-efee11392d95 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031812 Aug 19 16:35:53.578653 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 315/634] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:35:53.612901 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2ba93ea6-bf44-40bb-bccb-b93770fbb06e tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:53.615022 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2ba93ea6-bf44-40bb-bccb-b93770fbb06e tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:53.621402 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ba93ea6-bf44-40bb-bccb-b93770fbb06e tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:53.621771 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-69caf0d0-4c8b-45e9-8b8c-d599c4c14fee tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:53.621921 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ba93ea6-bf44-40bb-bccb-b93770fbb06e tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:53.622367 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ba93ea6-bf44-40bb-bccb-b93770fbb06e tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:53.622922 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-69caf0d0-4c8b-45e9-8b8c-d599c4c14fee tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:53.623069 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ba93ea6-bf44-40bb-bccb-b93770fbb06e tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:53.623719 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ba93ea6-bf44-40bb-bccb-b93770fbb06e tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:53.624153 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ba93ea6-bf44-40bb-bccb-b93770fbb06e tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:53.631178 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-69caf0d0-4c8b-45e9-8b8c-d599c4c14fee tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:53.631791 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-69caf0d0-4c8b-45e9-8b8c-d599c4c14fee tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:53.632946 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-69caf0d0-4c8b-45e9-8b8c-d599c4c14fee tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:53.634228 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-69caf0d0-4c8b-45e9-8b8c-d599c4c14fee tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:53.634806 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-69caf0d0-4c8b-45e9-8b8c-d599c4c14fee tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:53.635334 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-69caf0d0-4c8b-45e9-8b8c-d599c4c14fee tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:53.765562 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2ba93ea6-bf44-40bb-bccb-b93770fbb06e tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:53.771570 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-69caf0d0-4c8b-45e9-8b8c-d599c4c14fee tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:53.773993 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2ba93ea6-bf44-40bb-bccb-b93770fbb06e tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.164912 Aug 19 16:35:53.774563 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 320/635] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:53 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:53.780654 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-69caf0d0-4c8b-45e9-8b8c-d599c4c14fee tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:53.782218 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-69caf0d0-4c8b-45e9-8b8c-d599c4c14fee tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:53.783397 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-69caf0d0-4c8b-45e9-8b8c-d599c4c14fee tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1809 microversion: 2.20 time: 0.166428 Aug 19 16:35:53.783944 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 316/636] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:53 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:35:53.822309 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1cc712cb-e61b-45d7-9546-22a1d719ebb3 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:53.822817 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-1cc712cb-e61b-45d7-9546-22a1d719ebb3 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:53.828935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1cc712cb-e61b-45d7-9546-22a1d719ebb3 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:53.829410 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1cc712cb-e61b-45d7-9546-22a1d719ebb3 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:53.829840 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1cc712cb-e61b-45d7-9546-22a1d719ebb3 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:53.830516 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1cc712cb-e61b-45d7-9546-22a1d719ebb3 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:53.830965 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1cc712cb-e61b-45d7-9546-22a1d719ebb3 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:53.831383 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1cc712cb-e61b-45d7-9546-22a1d719ebb3 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:53.854672 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-1cc712cb-e61b-45d7-9546-22a1d719ebb3 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3/ips" status: 200 len: 150 microversion: 2.1 time: 0.036161 Aug 19 16:35:53.855147 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 321/637] 10.222.0.55 () {58 vars in 1248 bytes} [Fri Aug 19 16:35:53 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:35:53.866435 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a406f01e-d965-4c79-97d7-3a6ca93c2272 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a191975-dc72-49fd-b26d-3e605ddb5a23"}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:35:53.868722 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a406f01e-d965-4c79-97d7-3a6ca93c2272 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:53.874827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a406f01e-d965-4c79-97d7-3a6ca93c2272 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:53.875301 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a406f01e-d965-4c79-97d7-3a6ca93c2272 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:53.875730 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a406f01e-d965-4c79-97d7-3a6ca93c2272 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:53.876407 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a406f01e-d965-4c79-97d7-3a6ca93c2272 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:53.876890 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a406f01e-d965-4c79-97d7-3a6ca93c2272 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:53.877311 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a406f01e-d965-4c79-97d7-3a6ca93c2272 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:53.962695 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-a406f01e-d965-4c79-97d7-3a6ca93c2272 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] HTTP exception thrown: Invalid volume: volume 7a191975-dc72-49fd-b26d-3e605ddb5a23 is already attached to instances: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a406f01e-d965-4c79-97d7-3a6ca93c2272 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Request method failure captured: Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: POST /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3/os-volume_attachments HTTP/1.1 Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 74 Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7sAw9LcxO6N0pZY1nhZLJGTFHO5NOhvu1eVk6xTEodx-7uYGCVFosqHM2vYV2yCCDgERTbLEbTufj2duylmwK82XOJGkc69LfohAu5wx0GlI5NYAoHX6aVSGY0q6pl5_M_R0V-WnUvH1N5W6DXSAAPQV7ymDnRnchpgyuPHrFewp9k Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:35:53.964442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:35:53.966044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1743538991c8415394ac6cd5aed28d6a"}]}] Aug 19 16:35:53.966044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:35:53.966044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:35:53.966044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:35:53.966044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:35:53.966044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:35:53.966044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:35:53.966044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: 9b0455ae3ec94c929c940df6a0f6687d Aug 19 16:35:53.966044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:35:53.966044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Aug 19 16:35:53.966044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {"volumeAttachment": {"volumeId": "7a191975-dc72-49fd-b26d-3e605ddb5a23"}} Aug 19 16:35:53.966044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:35:53.966907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Invalid volume: volume 7a191975-dc72-49fd-b26d-3e605ddb5a23 is already attached to instances: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 Aug 19 16:35:53.966907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'server_id': '66209407-a95b-4602-8c4c-b00baa5104e3', 'body': {'volumeAttachment': {'volumeId': '7a191975-dc72-49fd-b26d-3e605ddb5a23'}}} Aug 19 16:35:53.966907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:35:53.966907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:35:53.966907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 19 16:35:53.966907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 19 16:35:53.966907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 19 16:35:53.966907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 19 16:35:53.966907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 19 16:35:53.966907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 19 16:35:53.966907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5119, in attach_volume Aug 19 16:35:53.966907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 19 16:35:53.966907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4959, in _check_volume_already_attached Aug 19 16:35:53.966907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 19 16:35:53.966907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7a191975-dc72-49fd-b26d-3e605ddb5a23 is already attached to instances: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 Aug 19 16:35:53.966907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:35:53.966907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:35:53.966907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:35:53.966907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:35:53.968293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:35:53.968293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:35:53.968293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:35:53.968293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:35:53.968293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:35:53.968293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:35:53.968293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 16:35:53.968293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 16:35:53.968293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 16:35:53.968293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 16:35:53.968293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 16:35:53.968293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 16:35:53.968293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 19 16:35:53.968293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 19 16:35:53.968293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7a191975-dc72-49fd-b26d-3e605ddb5a23 is already attached to instances: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 Aug 19 16:35:53.968293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:35:53.968293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:35:53.968293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:35:53.968293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:35:53.968293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:35:53.969836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:35:53.969836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:35:53.969836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:35:53.969836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7a191975-dc72-49fd-b26d-3e605ddb5a23 is already attached to instances: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 Aug 19 16:35:53.969836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:35:53.969836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a406f01e-d965-4c79-97d7-3a6ca93c2272 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Returning 400 to user: Invalid volume: volume 7a191975-dc72-49fd-b26d-3e605ddb5a23 is already attached to instances: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:35:53.969836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a406f01e-d965-4c79-97d7-3a6ca93c2272 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "POST /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103519 Aug 19 16:35:53.969836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 317/638] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Aug 19 16:35:53 2022] POST /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 19 16:35:53.974969 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d3ff23e1-e7ea-44b5-b18b-3777c2aa3a8d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:53.975470 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d3ff23e1-e7ea-44b5-b18b-3777c2aa3a8d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:53.981402 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d3ff23e1-e7ea-44b5-b18b-3777c2aa3a8d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:53.981880 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d3ff23e1-e7ea-44b5-b18b-3777c2aa3a8d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:53.982314 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d3ff23e1-e7ea-44b5-b18b-3777c2aa3a8d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:53.982997 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d3ff23e1-e7ea-44b5-b18b-3777c2aa3a8d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:53.983445 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d3ff23e1-e7ea-44b5-b18b-3777c2aa3a8d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:53.983870 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d3ff23e1-e7ea-44b5-b18b-3777c2aa3a8d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:54.008654 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d3ff23e1-e7ea-44b5-b18b-3777c2aa3a8d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Going to try to terminate instance {{(pid=127285) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:35:54.033618 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-5a9540c2-dfce-46e5-a790-19515e5267ba tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:54.034217 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-5a9540c2-dfce-46e5-a790-19515e5267ba tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:54.041068 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5a9540c2-dfce-46e5-a790-19515e5267ba tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:54.041554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5a9540c2-dfce-46e5-a790-19515e5267ba tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:54.041984 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5a9540c2-dfce-46e5-a790-19515e5267ba tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:54.042668 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5a9540c2-dfce-46e5-a790-19515e5267ba tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:54.043126 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5a9540c2-dfce-46e5-a790-19515e5267ba tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:54.043527 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5a9540c2-dfce-46e5-a790-19515e5267ba tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:54.087448 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d3ff23e1-e7ea-44b5-b18b-3777c2aa3a8d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "DELETE /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 204 len: 0 microversion: 2.1 time: 0.116184 Aug 19 16:35:54.088145 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 322/639] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:35:53 2022] DELETE /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:35:54.096659 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2705fa06-abde-4979-98b9-9db06bc443f6 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:54.097377 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2705fa06-abde-4979-98b9-9db06bc443f6 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:54.103736 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2705fa06-abde-4979-98b9-9db06bc443f6 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:54.104216 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2705fa06-abde-4979-98b9-9db06bc443f6 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:54.104667 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2705fa06-abde-4979-98b9-9db06bc443f6 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:54.105455 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2705fa06-abde-4979-98b9-9db06bc443f6 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:54.105857 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2705fa06-abde-4979-98b9-9db06bc443f6 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:54.106279 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2705fa06-abde-4979-98b9-9db06bc443f6 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:54.183394 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-5a9540c2-dfce-46e5-a790-19515e5267ba tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:54.192428 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-5a9540c2-dfce-46e5-a790-19515e5267ba tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.162483 Aug 19 16:35:54.193037 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 318/640] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:54 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:54.241715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2705fa06-abde-4979-98b9-9db06bc443f6 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:54.249356 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2705fa06-abde-4979-98b9-9db06bc443f6 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1679 microversion: 2.1 time: 0.156824 Aug 19 16:35:54.249918 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 323/641] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:54 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:54.795009 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-83dd6c0a-6168-4bb4-ac46-5a964e9b913f tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:54.795620 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-83dd6c0a-6168-4bb4-ac46-5a964e9b913f tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:54.802486 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-83dd6c0a-6168-4bb4-ac46-5a964e9b913f tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:54.802963 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-83dd6c0a-6168-4bb4-ac46-5a964e9b913f tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:54.803397 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-83dd6c0a-6168-4bb4-ac46-5a964e9b913f tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:54.804082 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-83dd6c0a-6168-4bb4-ac46-5a964e9b913f tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:54.804529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-83dd6c0a-6168-4bb4-ac46-5a964e9b913f tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:54.804981 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-83dd6c0a-6168-4bb4-ac46-5a964e9b913f tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:54.805297 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e6d9289a-51f8-4980-ac81-6a96ea1c727c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:54.805907 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e6d9289a-51f8-4980-ac81-6a96ea1c727c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:54.812274 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e6d9289a-51f8-4980-ac81-6a96ea1c727c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:54.812785 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e6d9289a-51f8-4980-ac81-6a96ea1c727c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:54.813206 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e6d9289a-51f8-4980-ac81-6a96ea1c727c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:54.814416 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e6d9289a-51f8-4980-ac81-6a96ea1c727c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:54.814416 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e6d9289a-51f8-4980-ac81-6a96ea1c727c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:54.814760 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e6d9289a-51f8-4980-ac81-6a96ea1c727c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:54.945767 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-83dd6c0a-6168-4bb4-ac46-5a964e9b913f tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:54.945936 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e6d9289a-51f8-4980-ac81-6a96ea1c727c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:54.954033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-83dd6c0a-6168-4bb4-ac46-5a964e9b913f tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.162746 Aug 19 16:35:54.962259 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 319/642] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:54 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:54.964180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e6d9289a-51f8-4980-ac81-6a96ea1c727c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:54.965791 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e6d9289a-51f8-4980-ac81-6a96ea1c727c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:54.967029 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e6d9289a-51f8-4980-ac81-6a96ea1c727c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1796 microversion: 2.20 time: 0.165524 Aug 19 16:35:54.967646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 324/643] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:35:54 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1796 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:35:55.212576 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e84efd68-9f23-41ca-a23d-d9cb2af829ac tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:55.213230 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-e84efd68-9f23-41ca-a23d-d9cb2af829ac tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:55.219173 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e84efd68-9f23-41ca-a23d-d9cb2af829ac tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:55.219650 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e84efd68-9f23-41ca-a23d-d9cb2af829ac tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:55.220083 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e84efd68-9f23-41ca-a23d-d9cb2af829ac tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:55.220778 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e84efd68-9f23-41ca-a23d-d9cb2af829ac tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:55.221230 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e84efd68-9f23-41ca-a23d-d9cb2af829ac tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:55.221688 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e84efd68-9f23-41ca-a23d-d9cb2af829ac tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:55.271929 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ff05f6db-d029-44a8-9fc7-abccbfd5a064 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:55.272541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ff05f6db-d029-44a8-9fc7-abccbfd5a064 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:55.278567 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ff05f6db-d029-44a8-9fc7-abccbfd5a064 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:55.279047 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ff05f6db-d029-44a8-9fc7-abccbfd5a064 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:55.279477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ff05f6db-d029-44a8-9fc7-abccbfd5a064 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:55.280184 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ff05f6db-d029-44a8-9fc7-abccbfd5a064 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:55.280622 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ff05f6db-d029-44a8-9fc7-abccbfd5a064 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:55.281076 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ff05f6db-d029-44a8-9fc7-abccbfd5a064 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:55.352532 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e84efd68-9f23-41ca-a23d-d9cb2af829ac tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:55.360398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e84efd68-9f23-41ca-a23d-d9cb2af829ac tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.151490 Aug 19 16:35:55.360992 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 320/644] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:55 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:55.412549 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ff05f6db-d029-44a8-9fc7-abccbfd5a064 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:55.420138 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ff05f6db-d029-44a8-9fc7-abccbfd5a064 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1679 microversion: 2.1 time: 0.152844 Aug 19 16:35:55.420687 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 325/645] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:55 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:55.912067 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-65a57e6a-4c73-4e12-bafc-93e1f487a1a4 req-921a157b-7c4b-44e7-96af-042212a4028b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4034526-7330-4541-a2cb-d646a572d9d8", "name": "network-vif-plugged", "status": "completed", "tag": "498a3f32-b577-44b6-8701-625d4a4962ec"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:35:55.922728 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-65a57e6a-4c73-4e12-bafc-93e1f487a1a4 req-921a157b-7c4b-44e7-96af-042212a4028b service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:55.923210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-65a57e6a-4c73-4e12-bafc-93e1f487a1a4 req-921a157b-7c4b-44e7-96af-042212a4028b service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:55.923652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-65a57e6a-4c73-4e12-bafc-93e1f487a1a4 req-921a157b-7c4b-44e7-96af-042212a4028b service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:55.938549 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-65a57e6a-4c73-4e12-bafc-93e1f487a1a4 req-921a157b-7c4b-44e7-96af-042212a4028b service nova] Creating event network-vif-plugged:498a3f32-b577-44b6-8701-625d4a4962ec for instance d4034526-7330-4541-a2cb-d646a572d9d8 on hv-cinder-83124 Aug 19 16:35:55.944093 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-65a57e6a-4c73-4e12-bafc-93e1f487a1a4 req-921a157b-7c4b-44e7-96af-042212a4028b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035733 Aug 19 16:35:55.944723 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 321/646] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:35:55.975558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-11aaf633-e3e3-41c7-887d-73f0d3542c35 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:55.976228 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-11aaf633-e3e3-41c7-887d-73f0d3542c35 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:55.983445 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-11aaf633-e3e3-41c7-887d-73f0d3542c35 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:55.983941 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-11aaf633-e3e3-41c7-887d-73f0d3542c35 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:55.984415 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-11aaf633-e3e3-41c7-887d-73f0d3542c35 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:55.985150 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-11aaf633-e3e3-41c7-887d-73f0d3542c35 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:55.985601 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-11aaf633-e3e3-41c7-887d-73f0d3542c35 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:55.986023 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-11aaf633-e3e3-41c7-887d-73f0d3542c35 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:56.126316 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-11aaf633-e3e3-41c7-887d-73f0d3542c35 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:56.133913 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-11aaf633-e3e3-41c7-887d-73f0d3542c35 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.163230 Aug 19 16:35:56.134474 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 326/647] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:55 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:56.381786 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-afceac7e-4322-422c-a214-d8ff5bf2dcb9 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:56.382510 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-afceac7e-4322-422c-a214-d8ff5bf2dcb9 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:56.388809 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-afceac7e-4322-422c-a214-d8ff5bf2dcb9 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:56.389311 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-afceac7e-4322-422c-a214-d8ff5bf2dcb9 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:56.389725 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-afceac7e-4322-422c-a214-d8ff5bf2dcb9 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:56.390405 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-afceac7e-4322-422c-a214-d8ff5bf2dcb9 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:56.390853 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-afceac7e-4322-422c-a214-d8ff5bf2dcb9 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:56.391273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-afceac7e-4322-422c-a214-d8ff5bf2dcb9 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:56.442451 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-65b27d6d-1ac2-4c1d-bced-309ff3243bff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:56.443164 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-65b27d6d-1ac2-4c1d-bced-309ff3243bff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:56.449202 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-65b27d6d-1ac2-4c1d-bced-309ff3243bff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:56.449683 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-65b27d6d-1ac2-4c1d-bced-309ff3243bff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:56.450112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-65b27d6d-1ac2-4c1d-bced-309ff3243bff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:56.450795 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-65b27d6d-1ac2-4c1d-bced-309ff3243bff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:56.451241 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-65b27d6d-1ac2-4c1d-bced-309ff3243bff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:56.451914 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-65b27d6d-1ac2-4c1d-bced-309ff3243bff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:56.521223 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-afceac7e-4322-422c-a214-d8ff5bf2dcb9 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:56.528952 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-afceac7e-4322-422c-a214-d8ff5bf2dcb9 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.151371 Aug 19 16:35:56.529510 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 322/648] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:56 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:56.583391 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-65b27d6d-1ac2-4c1d-bced-309ff3243bff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:56.586945 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:35:56.592103 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-65b27d6d-1ac2-4c1d-bced-309ff3243bff tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1679 microversion: 2.1 time: 0.153645 Aug 19 16:35:56.592667 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 327/649] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:56 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:57.154440 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-15854935-27c3-427e-9581-de4557f3d105 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:57.155047 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-15854935-27c3-427e-9581-de4557f3d105 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:57.161032 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-15854935-27c3-427e-9581-de4557f3d105 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:57.161512 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-15854935-27c3-427e-9581-de4557f3d105 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:57.161942 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-15854935-27c3-427e-9581-de4557f3d105 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:57.162625 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-15854935-27c3-427e-9581-de4557f3d105 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:57.163069 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-15854935-27c3-427e-9581-de4557f3d105 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:57.163487 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-15854935-27c3-427e-9581-de4557f3d105 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:57.291443 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-15854935-27c3-427e-9581-de4557f3d105 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:57.299131 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-15854935-27c3-427e-9581-de4557f3d105 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.148578 Aug 19 16:35:57.299693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 323/650] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:57 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:57.416337 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-7484df7d-283f-4b33-bb30-8cedbc396fc3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:35:57.418666 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-7484df7d-283f-4b33-bb30-8cedbc396fc3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:57.426571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7484df7d-283f-4b33-bb30-8cedbc396fc3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:57.427048 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7484df7d-283f-4b33-bb30-8cedbc396fc3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:57.427476 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7484df7d-283f-4b33-bb30-8cedbc396fc3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:57.428155 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7484df7d-283f-4b33-bb30-8cedbc396fc3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:57.428609 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7484df7d-283f-4b33-bb30-8cedbc396fc3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:57.429055 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7484df7d-283f-4b33-bb30-8cedbc396fc3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:57.452633 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.objects.instance [None req-7484df7d-283f-4b33-bb30-8cedbc396fc3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lazy-loading 'flavor' on Instance uuid 9ed4c246-7322-49b8-9bf7-2efaacc54b0b {{(pid=127285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:35:57.549313 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-dd3fd47d-9a2f-4265-a5ac-8b6c41340052 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:57.550065 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-dd3fd47d-9a2f-4265-a5ac-8b6c41340052 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:57.558243 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd3fd47d-9a2f-4265-a5ac-8b6c41340052 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:57.558719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd3fd47d-9a2f-4265-a5ac-8b6c41340052 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:57.559148 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd3fd47d-9a2f-4265-a5ac-8b6c41340052 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:57.559873 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd3fd47d-9a2f-4265-a5ac-8b6c41340052 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:57.560318 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd3fd47d-9a2f-4265-a5ac-8b6c41340052 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:57.560736 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd3fd47d-9a2f-4265-a5ac-8b6c41340052 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:57.578613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-7484df7d-283f-4b33-bb30-8cedbc396fc3 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "POST /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/action" status: 200 len: 32 microversion: 2.1 time: 0.166149 Aug 19 16:35:57.579437 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 328/651] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Aug 19 16:35:57 2022] POST /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 16:35:57.589643 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e86a8ddf-5296-4c6d-97f3-29b1c1010eba tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:57.590488 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e86a8ddf-5296-4c6d-97f3-29b1c1010eba tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:57.596930 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e86a8ddf-5296-4c6d-97f3-29b1c1010eba tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:57.598064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e86a8ddf-5296-4c6d-97f3-29b1c1010eba tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:57.598454 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e86a8ddf-5296-4c6d-97f3-29b1c1010eba tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:57.599157 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e86a8ddf-5296-4c6d-97f3-29b1c1010eba tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:57.599622 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e86a8ddf-5296-4c6d-97f3-29b1c1010eba tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:57.600049 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e86a8ddf-5296-4c6d-97f3-29b1c1010eba tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:57.699619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-dd3fd47d-9a2f-4265-a5ac-8b6c41340052 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:57.707757 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-dd3fd47d-9a2f-4265-a5ac-8b6c41340052 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.162201 Aug 19 16:35:57.708420 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 324/652] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:57 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:57.713009 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-bb543c4d-0cd5-4df8-8d7b-2723e00cff59 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:57.713685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-bb543c4d-0cd5-4df8-8d7b-2723e00cff59 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:57.719410 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bb543c4d-0cd5-4df8-8d7b-2723e00cff59 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:57.719967 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bb543c4d-0cd5-4df8-8d7b-2723e00cff59 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:57.720468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bb543c4d-0cd5-4df8-8d7b-2723e00cff59 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:57.721252 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bb543c4d-0cd5-4df8-8d7b-2723e00cff59 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:57.721706 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bb543c4d-0cd5-4df8-8d7b-2723e00cff59 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:57.722125 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bb543c4d-0cd5-4df8-8d7b-2723e00cff59 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:57.733351 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e86a8ddf-5296-4c6d-97f3-29b1c1010eba tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:57.742561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e86a8ddf-5296-4c6d-97f3-29b1c1010eba tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.157273 Aug 19 16:35:57.743192 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 329/653] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:57 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:57.850018 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-bb543c4d-0cd5-4df8-8d7b-2723e00cff59 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:57.857644 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-bb543c4d-0cd5-4df8-8d7b-2723e00cff59 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1679 microversion: 2.1 time: 0.148162 Aug 19 16:35:57.858208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 325/654] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:57 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:58.321141 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c502b175-c8ca-4029-bff5-6eab16853976 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:58.321788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c502b175-c8ca-4029-bff5-6eab16853976 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:58.328033 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c502b175-c8ca-4029-bff5-6eab16853976 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:58.328524 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c502b175-c8ca-4029-bff5-6eab16853976 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:58.328988 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c502b175-c8ca-4029-bff5-6eab16853976 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:58.329675 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c502b175-c8ca-4029-bff5-6eab16853976 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:58.330128 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c502b175-c8ca-4029-bff5-6eab16853976 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:58.330558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c502b175-c8ca-4029-bff5-6eab16853976 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:58.457593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c502b175-c8ca-4029-bff5-6eab16853976 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:58.465120 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c502b175-c8ca-4029-bff5-6eab16853976 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1319 microversion: 2.1 time: 0.147814 Aug 19 16:35:58.465675 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 330/655] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:58 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:58.728519 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-49c7b9ad-8924-4ae2-9492-7a048b163901 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:58.729151 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-49c7b9ad-8924-4ae2-9492-7a048b163901 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:58.735502 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-49c7b9ad-8924-4ae2-9492-7a048b163901 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:58.735965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-49c7b9ad-8924-4ae2-9492-7a048b163901 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:58.736398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-49c7b9ad-8924-4ae2-9492-7a048b163901 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:58.737109 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-49c7b9ad-8924-4ae2-9492-7a048b163901 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:58.737559 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-49c7b9ad-8924-4ae2-9492-7a048b163901 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:58.738514 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-49c7b9ad-8924-4ae2-9492-7a048b163901 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:58.764546 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-15ea42a4-f4e3-4192-9de6-d997c9987fe9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:58.765180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-15ea42a4-f4e3-4192-9de6-d997c9987fe9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:58.771103 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-15ea42a4-f4e3-4192-9de6-d997c9987fe9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:58.771583 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-15ea42a4-f4e3-4192-9de6-d997c9987fe9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:58.772010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-15ea42a4-f4e3-4192-9de6-d997c9987fe9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:58.772697 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-15ea42a4-f4e3-4192-9de6-d997c9987fe9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:58.773176 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-15ea42a4-f4e3-4192-9de6-d997c9987fe9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:58.773603 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-15ea42a4-f4e3-4192-9de6-d997c9987fe9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:58.911897 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-15ea42a4-f4e3-4192-9de6-d997c9987fe9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:58.920180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-15ea42a4-f4e3-4192-9de6-d997c9987fe9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.159399 Aug 19 16:35:58.920746 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 331/656] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:58 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:35:58.925784 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6708bef2-f599-44ca-9b2a-cffd60c6ef0e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:58.926624 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6708bef2-f599-44ca-9b2a-cffd60c6ef0e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:58.937777 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6708bef2-f599-44ca-9b2a-cffd60c6ef0e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:58.938344 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6708bef2-f599-44ca-9b2a-cffd60c6ef0e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:58.938874 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6708bef2-f599-44ca-9b2a-cffd60c6ef0e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:58.939644 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6708bef2-f599-44ca-9b2a-cffd60c6ef0e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:58.940260 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6708bef2-f599-44ca-9b2a-cffd60c6ef0e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:58.940779 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6708bef2-f599-44ca-9b2a-cffd60c6ef0e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:58.960360 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-49c7b9ad-8924-4ae2-9492-7a048b163901 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:58.968327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-49c7b9ad-8924-4ae2-9492-7a048b163901 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1358 microversion: 2.1 time: 0.243607 Aug 19 16:35:58.969217 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 326/657] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:58 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:59.073611 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6708bef2-f599-44ca-9b2a-cffd60c6ef0e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:59.081653 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6708bef2-f599-44ca-9b2a-cffd60c6ef0e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1679 microversion: 2.1 time: 0.159795 Aug 19 16:35:59.082884 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 332/658] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:58 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:59.485616 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c41c5861-ff4f-4fbf-9aa5-9fa5907ee45d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:59.486329 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-c41c5861-ff4f-4fbf-9aa5-9fa5907ee45d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:59.492397 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c41c5861-ff4f-4fbf-9aa5-9fa5907ee45d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:59.492910 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c41c5861-ff4f-4fbf-9aa5-9fa5907ee45d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:59.493342 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c41c5861-ff4f-4fbf-9aa5-9fa5907ee45d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:59.494023 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c41c5861-ff4f-4fbf-9aa5-9fa5907ee45d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:59.494467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c41c5861-ff4f-4fbf-9aa5-9fa5907ee45d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:59.494879 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c41c5861-ff4f-4fbf-9aa5-9fa5907ee45d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:59.658396 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-37a5844e-dc20-4ac1-9c74-af17ae6de87f req-2e4b0a94-090a-44c3-9464-e1e84894e8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66209407-a95b-4602-8c4c-b00baa5104e3", "name": "network-vif-deleted", "tag": "10444959-dfba-4c06-911d-6a8b84b573d3"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:35:59.669483 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-37a5844e-dc20-4ac1-9c74-af17ae6de87f req-2e4b0a94-090a-44c3-9464-e1e84894e8a9 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:59.670139 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-37a5844e-dc20-4ac1-9c74-af17ae6de87f req-2e4b0a94-090a-44c3-9464-e1e84894e8a9 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:59.670724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-37a5844e-dc20-4ac1-9c74-af17ae6de87f req-2e4b0a94-090a-44c3-9464-e1e84894e8a9 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:59.683269 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-37a5844e-dc20-4ac1-9c74-af17ae6de87f req-2e4b0a94-090a-44c3-9464-e1e84894e8a9 service nova] Creating event network-vif-deleted:10444959-dfba-4c06-911d-6a8b84b573d3 for instance 66209407-a95b-4602-8c4c-b00baa5104e3 on hv-cinder-83124 Aug 19 16:35:59.688665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-37a5844e-dc20-4ac1-9c74-af17ae6de87f req-2e4b0a94-090a-44c3-9464-e1e84894e8a9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039484 Aug 19 16:35:59.689567 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 333/659] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:35:59.699701 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c41c5861-ff4f-4fbf-9aa5-9fa5907ee45d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:35:59.708603 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c41c5861-ff4f-4fbf-9aa5-9fa5907ee45d tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1508 microversion: 2.1 time: 0.226788 Aug 19 16:35:59.709378 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 327/660] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:59 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1508 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:35:59.730588 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3af45ce2-6dff-4621-bb97-0e445ed2adbb tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54803636-eaa3-4d8e-ba59-e35102db3fa6", "device": "/dev/sdb"}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:35:59.733073 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-3af45ce2-6dff-4621-bb97-0e445ed2adbb tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:59.740741 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3af45ce2-6dff-4621-bb97-0e445ed2adbb tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:59.741189 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3af45ce2-6dff-4621-bb97-0e445ed2adbb tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:59.741620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3af45ce2-6dff-4621-bb97-0e445ed2adbb tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:59.742308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3af45ce2-6dff-4621-bb97-0e445ed2adbb tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:59.742752 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3af45ce2-6dff-4621-bb97-0e445ed2adbb tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:59.743172 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3af45ce2-6dff-4621-bb97-0e445ed2adbb tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:59.942778 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-0a311fb7-7e68-4958-8b2d-5240cfb24cee tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:35:59.943478 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-0a311fb7-7e68-4958-8b2d-5240cfb24cee tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:35:59.949959 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0a311fb7-7e68-4958-8b2d-5240cfb24cee tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:59.950516 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0a311fb7-7e68-4958-8b2d-5240cfb24cee tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:59.951020 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0a311fb7-7e68-4958-8b2d-5240cfb24cee tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:35:59.952040 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0a311fb7-7e68-4958-8b2d-5240cfb24cee tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:35:59.952572 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0a311fb7-7e68-4958-8b2d-5240cfb24cee tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:35:59.953091 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0a311fb7-7e68-4958-8b2d-5240cfb24cee tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:00.139799 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-0a311fb7-7e68-4958-8b2d-5240cfb24cee tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:00.152153 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-0a311fb7-7e68-4958-8b2d-5240cfb24cee tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.213569 Aug 19 16:36:00.152732 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 328/661] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:35:59 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:36:00.168821 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b6bac763-66fc-44b1-ad05-01f4407321ce tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:00.169971 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-b6bac763-66fc-44b1-ad05-01f4407321ce tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:00.179107 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b6bac763-66fc-44b1-ad05-01f4407321ce tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:00.179755 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b6bac763-66fc-44b1-ad05-01f4407321ce tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:00.180411 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b6bac763-66fc-44b1-ad05-01f4407321ce tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:00.182124 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b6bac763-66fc-44b1-ad05-01f4407321ce tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:00.182812 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b6bac763-66fc-44b1-ad05-01f4407321ce tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:00.183435 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b6bac763-66fc-44b1-ad05-01f4407321ce tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:00.192557 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=100 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:00.330350 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b6bac763-66fc-44b1-ad05-01f4407321ce tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:00.338724 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b6bac763-66fc-44b1-ad05-01f4407321ce tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1547 microversion: 2.1 time: 0.181073 Aug 19 16:36:00.339303 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 329/662] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:00 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1547 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:00.343749 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b5c1959b-8ac5-486f-b4b0-e2c8f30713b0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:00.344355 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-b5c1959b-8ac5-486f-b4b0-e2c8f30713b0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:00.347367 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=100 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:00.352155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b5c1959b-8ac5-486f-b4b0-e2c8f30713b0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:00.352613 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b5c1959b-8ac5-486f-b4b0-e2c8f30713b0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:00.353079 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b5c1959b-8ac5-486f-b4b0-e2c8f30713b0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:00.353778 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b5c1959b-8ac5-486f-b4b0-e2c8f30713b0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:00.354228 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b5c1959b-8ac5-486f-b4b0-e2c8f30713b0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:00.354652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b5c1959b-8ac5-486f-b4b0-e2c8f30713b0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:00.422512 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b5c1959b-8ac5-486f-b4b0-e2c8f30713b0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:00.431142 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b5c1959b-8ac5-486f-b4b0-e2c8f30713b0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1325 microversion: 2.1 time: 0.090670 Aug 19 16:36:00.436839 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 330/663] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:00 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1325 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:00.436839 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b8b8a42b-c35a-42c9-abb6-29e29627350b tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:00.437394 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-b8b8a42b-c35a-42c9-abb6-29e29627350b tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:00.443725 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b8b8a42b-c35a-42c9-abb6-29e29627350b tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:00.444134 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b8b8a42b-c35a-42c9-abb6-29e29627350b tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:00.444842 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b8b8a42b-c35a-42c9-abb6-29e29627350b tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:00.445486 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b8b8a42b-c35a-42c9-abb6-29e29627350b tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:00.445927 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b8b8a42b-c35a-42c9-abb6-29e29627350b tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:00.446343 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b8b8a42b-c35a-42c9-abb6-29e29627350b tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:00.587672 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b8b8a42b-c35a-42c9-abb6-29e29627350b tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:00.595567 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b8b8a42b-c35a-42c9-abb6-29e29627350b tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1547 microversion: 2.1 time: 0.162633 Aug 19 16:36:00.596308 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 331/664] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:00 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:00.615441 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-028d3c6e-74ee-497d-9d38-be1b4958649f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:00.626683 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-028d3c6e-74ee-497d-9d38-be1b4958649f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:00.627459 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-028d3c6e-74ee-497d-9d38-be1b4958649f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Searching by: {'deleted': False, 'project_id': 'a41afd08d1324396940e3acaf49a34b3'} {{(pid=127284) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 19 16:36:00.634980 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-028d3c6e-74ee-497d-9d38-be1b4958649f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:00.636186 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-028d3c6e-74ee-497d-9d38-be1b4958649f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:00.636562 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-028d3c6e-74ee-497d-9d38-be1b4958649f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:00.637898 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-028d3c6e-74ee-497d-9d38-be1b4958649f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:00.645071 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-028d3c6e-74ee-497d-9d38-be1b4958649f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:00.645819 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-028d3c6e-74ee-497d-9d38-be1b4958649f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:00.741441 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.multi_cell_list [None req-028d3c6e-74ee-497d-9d38-be1b4958649f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127284) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 19 16:36:00.857492 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-028d3c6e-74ee-497d-9d38-be1b4958649f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.245991 Aug 19 16:36:00.858270 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 332/665] 10.222.0.55 () {58 vars in 1125 bytes} [Fri Aug 19 16:36:00 2022] GET /compute/v2.1/servers => generated 343 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:36:00.870499 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-352fa224-0c42-4a4b-b405-1439a5d5005a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:00.871187 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-352fa224-0c42-4a4b-b405-1439a5d5005a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:00.877202 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-352fa224-0c42-4a4b-b405-1439a5d5005a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:00.877677 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-352fa224-0c42-4a4b-b405-1439a5d5005a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:00.878112 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-352fa224-0c42-4a4b-b405-1439a5d5005a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:00.878805 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-352fa224-0c42-4a4b-b405-1439a5d5005a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:00.879410 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-352fa224-0c42-4a4b-b405-1439a5d5005a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:00.879832 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-352fa224-0c42-4a4b-b405-1439a5d5005a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:01.043837 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-352fa224-0c42-4a4b-b405-1439a5d5005a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:01.061234 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-352fa224-0c42-4a4b-b405-1439a5d5005a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1547 microversion: 2.1 time: 0.194852 Aug 19 16:36:01.072877 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 333/666] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:00 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1547 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:01.161369 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3af45ce2-6dff-4621-bb97-0e445ed2adbb tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "POST /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.435102 Aug 19 16:36:01.162532 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 334/667] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Aug 19 16:35:59 2022] POST /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34/os-volume_attachments => generated 194 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:01.175686 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-23bdde34-f691-4b7e-b633-62ea8960a914 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:01.176406 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-23bdde34-f691-4b7e-b633-62ea8960a914 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:01.184384 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-23bdde34-f691-4b7e-b633-62ea8960a914 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:01.185525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-23bdde34-f691-4b7e-b633-62ea8960a914 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:01.186847 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-23bdde34-f691-4b7e-b633-62ea8960a914 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:01.188042 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-23bdde34-f691-4b7e-b633-62ea8960a914 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:01.188522 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-23bdde34-f691-4b7e-b633-62ea8960a914 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:01.188991 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-23bdde34-f691-4b7e-b633-62ea8960a914 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:01.338660 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-23bdde34-f691-4b7e-b633-62ea8960a914 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:01.348738 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-23bdde34-f691-4b7e-b633-62ea8960a914 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.178020 Aug 19 16:36:01.352820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 334/668] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:01 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:01.459957 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-09afd023-27b8-48f8-a3e5-b4022c8f9492 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:01.460701 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-09afd023-27b8-48f8-a3e5-b4022c8f9492 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:01.467854 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-09afd023-27b8-48f8-a3e5-b4022c8f9492 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:01.468303 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-09afd023-27b8-48f8-a3e5-b4022c8f9492 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:01.468717 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-09afd023-27b8-48f8-a3e5-b4022c8f9492 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:01.469445 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-09afd023-27b8-48f8-a3e5-b4022c8f9492 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:01.469902 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-09afd023-27b8-48f8-a3e5-b4022c8f9492 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:01.470331 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-09afd023-27b8-48f8-a3e5-b4022c8f9492 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:01.505805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-09afd023-27b8-48f8-a3e5-b4022c8f9492 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:01.506482 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-09afd023-27b8-48f8-a3e5-b4022c8f9492 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:01.506935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-09afd023-27b8-48f8-a3e5-b4022c8f9492 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:01.507398 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.objects.instance [None req-09afd023-27b8-48f8-a3e5-b4022c8f9492 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lazy-loading 'fault' on Instance uuid 66209407-a95b-4602-8c4c-b00baa5104e3 {{(pid=127285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:36:01.559541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-09afd023-27b8-48f8-a3e5-b4022c8f9492 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:01.570108 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-09afd023-27b8-48f8-a3e5-b4022c8f9492 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 200 len: 1330 microversion: 2.1 time: 0.115589 Aug 19 16:36:01.572917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 335/669] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:01 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 1330 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:02.371336 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-dd01d841-96f4-4fa7-800c-1b2e5a18559d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:02.371935 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-dd01d841-96f4-4fa7-800c-1b2e5a18559d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:02.378594 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd01d841-96f4-4fa7-800c-1b2e5a18559d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:02.379072 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd01d841-96f4-4fa7-800c-1b2e5a18559d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:02.380138 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd01d841-96f4-4fa7-800c-1b2e5a18559d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:02.381223 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd01d841-96f4-4fa7-800c-1b2e5a18559d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:02.381679 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd01d841-96f4-4fa7-800c-1b2e5a18559d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:02.382102 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd01d841-96f4-4fa7-800c-1b2e5a18559d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:02.518345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-dd01d841-96f4-4fa7-800c-1b2e5a18559d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:02.526942 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-dd01d841-96f4-4fa7-800c-1b2e5a18559d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.159491 Aug 19 16:36:02.527534 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 335/670] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:02 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:02.592097 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4e6545b0-41f3-4c0b-b55e-ae0e34163c57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:02.592652 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-4e6545b0-41f3-4c0b-b55e-ae0e34163c57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:02.600441 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4e6545b0-41f3-4c0b-b55e-ae0e34163c57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:02.600964 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4e6545b0-41f3-4c0b-b55e-ae0e34163c57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:02.601404 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4e6545b0-41f3-4c0b-b55e-ae0e34163c57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:02.602166 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4e6545b0-41f3-4c0b-b55e-ae0e34163c57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:02.602626 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4e6545b0-41f3-4c0b-b55e-ae0e34163c57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:02.603049 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4e6545b0-41f3-4c0b-b55e-ae0e34163c57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:02.616857 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-4e6545b0-41f3-4c0b-b55e-ae0e34163c57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] HTTP exception thrown: Instance 66209407-a95b-4602-8c4c-b00baa5104e3 could not be found. Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4e6545b0-41f3-4c0b-b55e-ae0e34163c57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Request method failure captured: Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 HTTP/1.1 Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7sAw9LcxO6N0pZY1nhZLJGTFHO5NOhvu1eVk6xTEodx-7uYGCVFosqHM2vYV2yCCDgERTbLEbTufj2duylmwK82XOJGkc69LfohAu5wx0GlI5NYAoHX6aVSGY0q6pl5_M_R0V-WnUvH1N5W6DXSAAPQV7ymDnRnchpgyuPHrFewp9k Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:36:02.618504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:36:02.619698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1743538991c8415394ac6cd5aed28d6a"}]}] Aug 19 16:36:02.619698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:36:02.619698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:36:02.619698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:36:02.619698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:36:02.619698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:36:02.619698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:36:02.619698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: 9b0455ae3ec94c929c940df6a0f6687d Aug 19 16:36:02.619698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:36:02.619698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:36:02.619698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance 66209407-a95b-4602-8c4c-b00baa5104e3 could not be found. Aug 19 16:36:02.619698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': '66209407-a95b-4602-8c4c-b00baa5104e3'} Aug 19 16:36:02.620397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:36:02.620397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:36:02.620397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:36:02.620397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:36:02.620397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:36:02.620397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:36:02.620397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:36:02.620397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:36:02.620397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:36:02.620397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:36:02.620397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66209407-a95b-4602-8c4c-b00baa5104e3 could not be found. Aug 19 16:36:02.620397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:36:02.620397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:36:02.620397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:36:02.620397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:36:02.620397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:36:02.620397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:36:02.620397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:36:02.620397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:36:02.620397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:36:02.622112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:36:02.622112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:36:02.622112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:36:02.622112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:36:02.622112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:36:02.622112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:36:02.622112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:36:02.622112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66209407-a95b-4602-8c4c-b00baa5104e3 could not be found. Aug 19 16:36:02.622112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:36:02.622112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:36:02.622112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:36:02.622112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:36:02.622112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:36:02.622112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:36:02.622112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:36:02.622112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:36:02.622112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66209407-a95b-4602-8c4c-b00baa5104e3 could not be found. Aug 19 16:36:02.622112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:36:02.623369 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4e6545b0-41f3-4c0b-b55e-ae0e34163c57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Returning 404 to user: Instance 66209407-a95b-4602-8c4c-b00baa5104e3 could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:36:02.623369 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4e6545b0-41f3-4c0b-b55e-ae0e34163c57 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 404 len: 111 microversion: 2.1 time: 0.031644 Aug 19 16:36:02.623369 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 336/671] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:02 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:36:02.628619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-3c661cc4-11ec-427a-b336-6300c99fca4a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '.version_select at 0x7fb01e038160>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:02.651354 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-3c661cc4-11ec-427a-b336-6300c99fca4a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1146901198" status: 202 len: 0 microversion: 2.1 time: 0.026421 Aug 19 16:36:02.652136 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 336/672] 10.222.0.55 () {58 vars in 1221 bytes} [Fri Aug 19 16:36:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1146901198 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:36:02.680600 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ddbd4a1a-84d3-4997-8c76-2fb8b09b2387 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62ae547b-ada4-4583-9cb2-fc14c5be98c0"}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:36:02.683059 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ddbd4a1a-84d3-4997-8c76-2fb8b09b2387 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:02.689195 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ddbd4a1a-84d3-4997-8c76-2fb8b09b2387 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:02.689683 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ddbd4a1a-84d3-4997-8c76-2fb8b09b2387 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:02.690124 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ddbd4a1a-84d3-4997-8c76-2fb8b09b2387 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:02.690820 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ddbd4a1a-84d3-4997-8c76-2fb8b09b2387 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:02.691279 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ddbd4a1a-84d3-4997-8c76-2fb8b09b2387 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:02.692562 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ddbd4a1a-84d3-4997-8c76-2fb8b09b2387 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:03.016223 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ddbd4a1a-84d3-4997-8c76-2fb8b09b2387 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "POST /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340170 Aug 19 16:36:03.017116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 337/673] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Aug 19 16:36:02 2022] POST /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:03.347147 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-94def047-f92e-4759-8389-29d85948211d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:03.347643 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-94def047-f92e-4759-8389-29d85948211d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:03.354648 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-94def047-f92e-4759-8389-29d85948211d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:03.355130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-94def047-f92e-4759-8389-29d85948211d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:03.355564 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-94def047-f92e-4759-8389-29d85948211d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:03.356281 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-94def047-f92e-4759-8389-29d85948211d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:03.356728 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-94def047-f92e-4759-8389-29d85948211d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:03.357173 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-94def047-f92e-4759-8389-29d85948211d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:03.479520 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.objects.instance [None req-94def047-f92e-4759-8389-29d85948211d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lazy-loading 'services' on Instance uuid 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 {{(pid=127284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:36:03.549212 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-486c2cb7-4961-4094-8a80-ba1a10a46bf1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:03.549927 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-486c2cb7-4961-4094-8a80-ba1a10a46bf1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:03.556902 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-486c2cb7-4961-4094-8a80-ba1a10a46bf1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:03.557390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-486c2cb7-4961-4094-8a80-ba1a10a46bf1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:03.557827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-486c2cb7-4961-4094-8a80-ba1a10a46bf1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:03.558525 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-486c2cb7-4961-4094-8a80-ba1a10a46bf1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:03.558981 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-486c2cb7-4961-4094-8a80-ba1a10a46bf1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:03.559410 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-486c2cb7-4961-4094-8a80-ba1a10a46bf1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:03.596066 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-94def047-f92e-4759-8389-29d85948211d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments/7a191975-dc72-49fd-b26d-3e605ddb5a23" status: 202 len: 0 microversion: 2.1 time: 0.252621 Aug 19 16:36:03.596959 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 337/674] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Aug 19 16:36:03 2022] DELETE /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments/7a191975-dc72-49fd-b26d-3e605ddb5a23 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:36:03.605842 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8e354d08-dc44-461d-b09d-14e2655d571d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:03.608212 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8e354d08-dc44-461d-b09d-14e2655d571d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:03.614750 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8e354d08-dc44-461d-b09d-14e2655d571d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:03.615242 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8e354d08-dc44-461d-b09d-14e2655d571d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:03.615683 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8e354d08-dc44-461d-b09d-14e2655d571d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:03.616383 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8e354d08-dc44-461d-b09d-14e2655d571d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:03.616939 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8e354d08-dc44-461d-b09d-14e2655d571d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:03.617372 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8e354d08-dc44-461d-b09d-14e2655d571d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:03.651222 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8e354d08-dc44-461d-b09d-14e2655d571d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049523 Aug 19 16:36:03.656069 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 338/675] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:36:03 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:36:03.709334 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-486c2cb7-4961-4094-8a80-ba1a10a46bf1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:03.717913 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-486c2cb7-4961-4094-8a80-ba1a10a46bf1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.173543 Aug 19 16:36:03.718472 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 338/676] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:03 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:36:04.664629 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2d3bb4fa-d269-4ab8-b9c1-9debe1aea948 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:04.666767 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2d3bb4fa-d269-4ab8-b9c1-9debe1aea948 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:04.673239 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2d3bb4fa-d269-4ab8-b9c1-9debe1aea948 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:04.673717 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2d3bb4fa-d269-4ab8-b9c1-9debe1aea948 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:04.674152 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2d3bb4fa-d269-4ab8-b9c1-9debe1aea948 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:04.674831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2d3bb4fa-d269-4ab8-b9c1-9debe1aea948 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:04.675282 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2d3bb4fa-d269-4ab8-b9c1-9debe1aea948 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:04.675702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2d3bb4fa-d269-4ab8-b9c1-9debe1aea948 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:04.705245 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2d3bb4fa-d269-4ab8-b9c1-9debe1aea948 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045523 Aug 19 16:36:04.705798 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 339/677] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:36:04 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:04.738384 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-9d120f5c-36cc-4be6-8556-30af7e314efe tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:04.739081 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-9d120f5c-36cc-4be6-8556-30af7e314efe tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:04.745893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9d120f5c-36cc-4be6-8556-30af7e314efe tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:04.746378 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9d120f5c-36cc-4be6-8556-30af7e314efe tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:04.746821 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9d120f5c-36cc-4be6-8556-30af7e314efe tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:04.747510 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9d120f5c-36cc-4be6-8556-30af7e314efe tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:04.747967 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9d120f5c-36cc-4be6-8556-30af7e314efe tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:04.748396 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9d120f5c-36cc-4be6-8556-30af7e314efe tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:04.878038 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-9d120f5c-36cc-4be6-8556-30af7e314efe tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:04.886376 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-9d120f5c-36cc-4be6-8556-30af7e314efe tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.151830 Aug 19 16:36:04.886931 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 339/678] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:04 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:05.718230 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-408c4c6b-1949-4ce6-af24-3ff594ca4974 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:05.720320 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-408c4c6b-1949-4ce6-af24-3ff594ca4974 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:05.727426 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-408c4c6b-1949-4ce6-af24-3ff594ca4974 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:05.727903 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-408c4c6b-1949-4ce6-af24-3ff594ca4974 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:05.728340 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-408c4c6b-1949-4ce6-af24-3ff594ca4974 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:05.729050 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-408c4c6b-1949-4ce6-af24-3ff594ca4974 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:05.729506 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-408c4c6b-1949-4ce6-af24-3ff594ca4974 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:05.729935 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-408c4c6b-1949-4ce6-af24-3ff594ca4974 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:05.758993 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-408c4c6b-1949-4ce6-af24-3ff594ca4974 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044748 Aug 19 16:36:05.759538 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 340/679] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:36:05 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:05.907370 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-26627977-aeda-4b26-b145-2827d9fa1c46 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:05.907970 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-26627977-aeda-4b26-b145-2827d9fa1c46 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:05.910378 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:05.915564 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-26627977-aeda-4b26-b145-2827d9fa1c46 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:05.916042 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-26627977-aeda-4b26-b145-2827d9fa1c46 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:05.916473 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-26627977-aeda-4b26-b145-2827d9fa1c46 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:05.917182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-26627977-aeda-4b26-b145-2827d9fa1c46 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:05.917630 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-26627977-aeda-4b26-b145-2827d9fa1c46 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:05.918052 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-26627977-aeda-4b26-b145-2827d9fa1c46 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:06.044643 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-26627977-aeda-4b26-b145-2827d9fa1c46 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:06.047957 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:06.054582 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-26627977-aeda-4b26-b145-2827d9fa1c46 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.151070 Aug 19 16:36:06.055146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 340/680] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:05 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:06.771358 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-3a114797-9706-423e-9592-960c89efd853 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:06.773527 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-3a114797-9706-423e-9592-960c89efd853 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:06.779913 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a114797-9706-423e-9592-960c89efd853 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:06.780397 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a114797-9706-423e-9592-960c89efd853 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:06.780858 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a114797-9706-423e-9592-960c89efd853 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:06.781542 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a114797-9706-423e-9592-960c89efd853 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:06.781992 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a114797-9706-423e-9592-960c89efd853 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:06.782414 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3a114797-9706-423e-9592-960c89efd853 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:06.811706 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-3a114797-9706-423e-9592-960c89efd853 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044372 Aug 19 16:36:06.812284 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 341/681] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:36:06 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:07.077323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-50a07e8b-53d2-4270-96af-b0bda6da9516 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:07.077876 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-50a07e8b-53d2-4270-96af-b0bda6da9516 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:07.086330 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-50a07e8b-53d2-4270-96af-b0bda6da9516 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:07.086820 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-50a07e8b-53d2-4270-96af-b0bda6da9516 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:07.087260 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-50a07e8b-53d2-4270-96af-b0bda6da9516 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:07.087958 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-50a07e8b-53d2-4270-96af-b0bda6da9516 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:07.088416 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-50a07e8b-53d2-4270-96af-b0bda6da9516 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:07.088870 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-50a07e8b-53d2-4270-96af-b0bda6da9516 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:07.215109 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-50a07e8b-53d2-4270-96af-b0bda6da9516 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:07.223908 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-50a07e8b-53d2-4270-96af-b0bda6da9516 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.150847 Aug 19 16:36:07.224461 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 341/682] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:07 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:07.823975 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2ee170ae-0d45-4abb-b549-aa6c5983cfc4 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:07.826374 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2ee170ae-0d45-4abb-b549-aa6c5983cfc4 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:07.833090 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2ee170ae-0d45-4abb-b549-aa6c5983cfc4 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:07.833574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2ee170ae-0d45-4abb-b549-aa6c5983cfc4 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:07.834009 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2ee170ae-0d45-4abb-b549-aa6c5983cfc4 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:07.834688 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2ee170ae-0d45-4abb-b549-aa6c5983cfc4 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:07.835136 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2ee170ae-0d45-4abb-b549-aa6c5983cfc4 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:07.835573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2ee170ae-0d45-4abb-b549-aa6c5983cfc4 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:07.864470 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2ee170ae-0d45-4abb-b549-aa6c5983cfc4 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043762 Aug 19 16:36:07.865041 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 342/683] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:36:07 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:08.245671 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-12855136-3ab5-4cd4-81b8-9f46e7e46361 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:08.246313 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-12855136-3ab5-4cd4-81b8-9f46e7e46361 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:08.252614 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-12855136-3ab5-4cd4-81b8-9f46e7e46361 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:08.253126 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-12855136-3ab5-4cd4-81b8-9f46e7e46361 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:08.253557 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-12855136-3ab5-4cd4-81b8-9f46e7e46361 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:08.254468 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-12855136-3ab5-4cd4-81b8-9f46e7e46361 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:08.254922 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-12855136-3ab5-4cd4-81b8-9f46e7e46361 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:08.255349 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-12855136-3ab5-4cd4-81b8-9f46e7e46361 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:08.384891 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-12855136-3ab5-4cd4-81b8-9f46e7e46361 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:08.393022 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-12855136-3ab5-4cd4-81b8-9f46e7e46361 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.151143 Aug 19 16:36:08.393571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 342/684] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:08 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:08.876887 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c2124afb-ea28-4600-b23d-bc3aa24f2361 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:08.880429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-c2124afb-ea28-4600-b23d-bc3aa24f2361 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:08.886940 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c2124afb-ea28-4600-b23d-bc3aa24f2361 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:08.887423 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c2124afb-ea28-4600-b23d-bc3aa24f2361 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:08.887854 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c2124afb-ea28-4600-b23d-bc3aa24f2361 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:08.888542 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c2124afb-ea28-4600-b23d-bc3aa24f2361 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:08.889014 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c2124afb-ea28-4600-b23d-bc3aa24f2361 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:08.889437 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c2124afb-ea28-4600-b23d-bc3aa24f2361 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:08.919256 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c2124afb-ea28-4600-b23d-bc3aa24f2361 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046345 Aug 19 16:36:08.919827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 343/685] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:36:08 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:09.416501 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6f081da4-e30d-4a1a-ad96-1c7aecbef8f0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:09.417476 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6f081da4-e30d-4a1a-ad96-1c7aecbef8f0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:09.425222 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6f081da4-e30d-4a1a-ad96-1c7aecbef8f0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:09.425705 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6f081da4-e30d-4a1a-ad96-1c7aecbef8f0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:09.426160 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6f081da4-e30d-4a1a-ad96-1c7aecbef8f0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:09.426959 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6f081da4-e30d-4a1a-ad96-1c7aecbef8f0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:09.427568 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6f081da4-e30d-4a1a-ad96-1c7aecbef8f0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:09.427969 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6f081da4-e30d-4a1a-ad96-1c7aecbef8f0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:09.568676 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6f081da4-e30d-4a1a-ad96-1c7aecbef8f0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:09.578186 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6f081da4-e30d-4a1a-ad96-1c7aecbef8f0 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.166409 Aug 19 16:36:09.578947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 343/686] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:09 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:09.932503 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-92cb705f-a233-4dc7-98cc-bb7ab80520c5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:09.934625 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-92cb705f-a233-4dc7-98cc-bb7ab80520c5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:09.941173 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-92cb705f-a233-4dc7-98cc-bb7ab80520c5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:09.942243 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-92cb705f-a233-4dc7-98cc-bb7ab80520c5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:09.942674 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-92cb705f-a233-4dc7-98cc-bb7ab80520c5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:09.943361 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-92cb705f-a233-4dc7-98cc-bb7ab80520c5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:09.943809 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-92cb705f-a233-4dc7-98cc-bb7ab80520c5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:09.944226 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-92cb705f-a233-4dc7-98cc-bb7ab80520c5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:09.973870 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-92cb705f-a233-4dc7-98cc-bb7ab80520c5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045287 Aug 19 16:36:09.974399 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 344/687] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:36:09 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:10.600121 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-26cb6d20-8564-4e64-b547-58a93614ed2d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:10.600727 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-26cb6d20-8564-4e64-b547-58a93614ed2d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:10.607091 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-26cb6d20-8564-4e64-b547-58a93614ed2d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:10.607572 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-26cb6d20-8564-4e64-b547-58a93614ed2d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:10.608004 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-26cb6d20-8564-4e64-b547-58a93614ed2d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:10.608685 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-26cb6d20-8564-4e64-b547-58a93614ed2d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:10.609183 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-26cb6d20-8564-4e64-b547-58a93614ed2d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:10.609605 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-26cb6d20-8564-4e64-b547-58a93614ed2d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:10.754526 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-26cb6d20-8564-4e64-b547-58a93614ed2d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:10.763427 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-26cb6d20-8564-4e64-b547-58a93614ed2d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.167788 Aug 19 16:36:10.764026 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 344/688] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:10 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:10.985831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f85f7c9f-ba65-474a-b898-8ce5c1c94926 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:10.987988 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f85f7c9f-ba65-474a-b898-8ce5c1c94926 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:10.990075 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=2 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:10.995841 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f85f7c9f-ba65-474a-b898-8ce5c1c94926 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:10.996315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f85f7c9f-ba65-474a-b898-8ce5c1c94926 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:10.996743 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f85f7c9f-ba65-474a-b898-8ce5c1c94926 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:10.997444 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f85f7c9f-ba65-474a-b898-8ce5c1c94926 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:10.997888 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f85f7c9f-ba65-474a-b898-8ce5c1c94926 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:10.998303 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f85f7c9f-ba65-474a-b898-8ce5c1c94926 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:11.023689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:11.028745 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f85f7c9f-ba65-474a-b898-8ce5c1c94926 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046827 Aug 19 16:36:11.029311 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 345/689] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:36:10 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:11.786339 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0a6e2263-c862-46f9-a723-7bb91abd4cb5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:11.786880 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-0a6e2263-c862-46f9-a723-7bb91abd4cb5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:11.793300 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0a6e2263-c862-46f9-a723-7bb91abd4cb5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:11.793783 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0a6e2263-c862-46f9-a723-7bb91abd4cb5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:11.794219 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0a6e2263-c862-46f9-a723-7bb91abd4cb5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:11.794958 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0a6e2263-c862-46f9-a723-7bb91abd4cb5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:11.795419 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0a6e2263-c862-46f9-a723-7bb91abd4cb5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:11.795848 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0a6e2263-c862-46f9-a723-7bb91abd4cb5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:11.926535 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-0a6e2263-c862-46f9-a723-7bb91abd4cb5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:11.934585 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-0a6e2263-c862-46f9-a723-7bb91abd4cb5 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.152416 Aug 19 16:36:11.935128 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 345/690] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:11 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:12.040351 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-572704b0-77b0-4722-a82a-758892f0554a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:12.042414 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-572704b0-77b0-4722-a82a-758892f0554a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:12.049717 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-572704b0-77b0-4722-a82a-758892f0554a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:12.050185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-572704b0-77b0-4722-a82a-758892f0554a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:12.050865 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-572704b0-77b0-4722-a82a-758892f0554a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:12.051568 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-572704b0-77b0-4722-a82a-758892f0554a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:12.052015 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-572704b0-77b0-4722-a82a-758892f0554a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:12.052432 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-572704b0-77b0-4722-a82a-758892f0554a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:12.083257 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-572704b0-77b0-4722-a82a-758892f0554a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047169 Aug 19 16:36:12.083798 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 346/691] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:36:12 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:12.955429 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-318cb3fb-9ea3-480a-bb6e-171d7e214e13 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:12.956042 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-318cb3fb-9ea3-480a-bb6e-171d7e214e13 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:12.963200 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-318cb3fb-9ea3-480a-bb6e-171d7e214e13 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:12.963683 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-318cb3fb-9ea3-480a-bb6e-171d7e214e13 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:12.964125 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-318cb3fb-9ea3-480a-bb6e-171d7e214e13 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:12.964843 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-318cb3fb-9ea3-480a-bb6e-171d7e214e13 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:12.965304 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-318cb3fb-9ea3-480a-bb6e-171d7e214e13 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:12.965732 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-318cb3fb-9ea3-480a-bb6e-171d7e214e13 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:13.093914 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-318cb3fb-9ea3-480a-bb6e-171d7e214e13 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:13.095895 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b05efa8b-86f5-40ee-a9a5-6db1408b2199 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:13.098675 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-b05efa8b-86f5-40ee-a9a5-6db1408b2199 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:13.102754 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-318cb3fb-9ea3-480a-bb6e-171d7e214e13 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.151066 Aug 19 16:36:13.103321 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 346/692] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:12 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:13.105169 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b05efa8b-86f5-40ee-a9a5-6db1408b2199 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:13.105720 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b05efa8b-86f5-40ee-a9a5-6db1408b2199 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:13.106218 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b05efa8b-86f5-40ee-a9a5-6db1408b2199 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:13.106989 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b05efa8b-86f5-40ee-a9a5-6db1408b2199 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:13.107506 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b05efa8b-86f5-40ee-a9a5-6db1408b2199 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:13.107991 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b05efa8b-86f5-40ee-a9a5-6db1408b2199 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:13.136193 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b05efa8b-86f5-40ee-a9a5-6db1408b2199 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044501 Aug 19 16:36:13.136739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 347/693] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:36:13 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:36:14.124265 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-76b359ca-3a33-460b-ad46-20df6b215030 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:14.124906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-76b359ca-3a33-460b-ad46-20df6b215030 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:14.131313 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76b359ca-3a33-460b-ad46-20df6b215030 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:14.131793 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76b359ca-3a33-460b-ad46-20df6b215030 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:14.132229 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76b359ca-3a33-460b-ad46-20df6b215030 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:14.132947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76b359ca-3a33-460b-ad46-20df6b215030 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:14.133400 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76b359ca-3a33-460b-ad46-20df6b215030 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:14.133821 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76b359ca-3a33-460b-ad46-20df6b215030 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:14.147597 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-cc84d6d0-00e0-489c-a8f9-8b4429079974 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:14.149962 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-cc84d6d0-00e0-489c-a8f9-8b4429079974 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:14.157181 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cc84d6d0-00e0-489c-a8f9-8b4429079974 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:14.157675 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cc84d6d0-00e0-489c-a8f9-8b4429079974 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:14.158118 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cc84d6d0-00e0-489c-a8f9-8b4429079974 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:14.158871 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cc84d6d0-00e0-489c-a8f9-8b4429079974 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:14.159268 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cc84d6d0-00e0-489c-a8f9-8b4429079974 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:14.159696 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cc84d6d0-00e0-489c-a8f9-8b4429079974 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:14.195159 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-cc84d6d0-00e0-489c-a8f9-8b4429079974 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051461 Aug 19 16:36:14.196085 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 348/694] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:36:14 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:36:14.265040 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-76b359ca-3a33-460b-ad46-20df6b215030 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:14.273541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-76b359ca-3a33-460b-ad46-20df6b215030 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.153161 Aug 19 16:36:14.274102 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 347/695] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:14 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:15.207717 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-fdc465d9-f1b4-410e-a53b-5d3c39d60e92 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:15.209825 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-fdc465d9-f1b4-410e-a53b-5d3c39d60e92 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:15.217534 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fdc465d9-f1b4-410e-a53b-5d3c39d60e92 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:15.218085 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fdc465d9-f1b4-410e-a53b-5d3c39d60e92 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:15.218459 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fdc465d9-f1b4-410e-a53b-5d3c39d60e92 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:15.219186 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fdc465d9-f1b4-410e-a53b-5d3c39d60e92 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:15.219634 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fdc465d9-f1b4-410e-a53b-5d3c39d60e92 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:15.220059 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fdc465d9-f1b4-410e-a53b-5d3c39d60e92 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:15.249898 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-fdc465d9-f1b4-410e-a53b-5d3c39d60e92 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046168 Aug 19 16:36:15.250379 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 349/696] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:36:15 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:15.295909 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-90aeb87c-30d1-48bf-b306-fc9add818dca tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:15.296524 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-90aeb87c-30d1-48bf-b306-fc9add818dca tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:15.303074 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-90aeb87c-30d1-48bf-b306-fc9add818dca tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:15.303556 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-90aeb87c-30d1-48bf-b306-fc9add818dca tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:15.303993 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-90aeb87c-30d1-48bf-b306-fc9add818dca tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:15.304737 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-90aeb87c-30d1-48bf-b306-fc9add818dca tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:15.305191 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-90aeb87c-30d1-48bf-b306-fc9add818dca tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:15.305612 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-90aeb87c-30d1-48bf-b306-fc9add818dca tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:15.434246 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-90aeb87c-30d1-48bf-b306-fc9add818dca tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:15.443143 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-90aeb87c-30d1-48bf-b306-fc9add818dca tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.151070 Aug 19 16:36:15.443702 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 348/697] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:15 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:16.262835 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-be984419-ea52-4f4a-83b2-5cf045ae6fd0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:16.264998 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-be984419-ea52-4f4a-83b2-5cf045ae6fd0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:16.271546 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-be984419-ea52-4f4a-83b2-5cf045ae6fd0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:16.272026 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-be984419-ea52-4f4a-83b2-5cf045ae6fd0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:16.272461 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-be984419-ea52-4f4a-83b2-5cf045ae6fd0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:16.273176 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-be984419-ea52-4f4a-83b2-5cf045ae6fd0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:16.273628 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-be984419-ea52-4f4a-83b2-5cf045ae6fd0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:16.274052 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-be984419-ea52-4f4a-83b2-5cf045ae6fd0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:16.303795 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-be984419-ea52-4f4a-83b2-5cf045ae6fd0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044853 Aug 19 16:36:16.304360 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 350/698] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:36:16 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:16.464932 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-9e503474-f5ce-40a7-8c32-cd8e8f57169e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:16.465545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-9e503474-f5ce-40a7-8c32-cd8e8f57169e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:16.471959 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9e503474-f5ce-40a7-8c32-cd8e8f57169e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:16.472390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9e503474-f5ce-40a7-8c32-cd8e8f57169e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:16.473398 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9e503474-f5ce-40a7-8c32-cd8e8f57169e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:16.474097 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9e503474-f5ce-40a7-8c32-cd8e8f57169e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:16.474550 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9e503474-f5ce-40a7-8c32-cd8e8f57169e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:16.474978 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9e503474-f5ce-40a7-8c32-cd8e8f57169e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:16.808399 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-9e503474-f5ce-40a7-8c32-cd8e8f57169e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:16.816600 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-9e503474-f5ce-40a7-8c32-cd8e8f57169e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.355474 Aug 19 16:36:16.817182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 349/699] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:16 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:17.315901 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-fd53aee9-c202-4e09-8bc1-027396e86280 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:17.318699 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-fd53aee9-c202-4e09-8bc1-027396e86280 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:17.325115 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fd53aee9-c202-4e09-8bc1-027396e86280 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:17.325851 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fd53aee9-c202-4e09-8bc1-027396e86280 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:17.326277 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fd53aee9-c202-4e09-8bc1-027396e86280 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:17.326949 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fd53aee9-c202-4e09-8bc1-027396e86280 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:17.327394 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fd53aee9-c202-4e09-8bc1-027396e86280 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:17.327808 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fd53aee9-c202-4e09-8bc1-027396e86280 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:17.356193 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-fd53aee9-c202-4e09-8bc1-027396e86280 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044269 Aug 19 16:36:17.356730 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 351/700] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:36:17 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:17.838060 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-655b1b86-17a9-4eff-a13b-c9e0f4e55e02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:17.838667 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-655b1b86-17a9-4eff-a13b-c9e0f4e55e02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:17.845214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-655b1b86-17a9-4eff-a13b-c9e0f4e55e02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:17.845694 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-655b1b86-17a9-4eff-a13b-c9e0f4e55e02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:17.846126 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-655b1b86-17a9-4eff-a13b-c9e0f4e55e02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:17.846812 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-655b1b86-17a9-4eff-a13b-c9e0f4e55e02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:17.847259 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-655b1b86-17a9-4eff-a13b-c9e0f4e55e02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:17.847706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-655b1b86-17a9-4eff-a13b-c9e0f4e55e02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:17.974055 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-655b1b86-17a9-4eff-a13b-c9e0f4e55e02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:17.982112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-655b1b86-17a9-4eff-a13b-c9e0f4e55e02 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.147871 Aug 19 16:36:17.982666 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 350/701] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:17 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:18.369121 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-43ee867f-3d92-4051-a02c-b109518a917f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:18.371320 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-43ee867f-3d92-4051-a02c-b109518a917f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:18.377628 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-43ee867f-3d92-4051-a02c-b109518a917f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:18.378103 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-43ee867f-3d92-4051-a02c-b109518a917f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:18.378532 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-43ee867f-3d92-4051-a02c-b109518a917f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:18.380014 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-43ee867f-3d92-4051-a02c-b109518a917f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:18.380470 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-43ee867f-3d92-4051-a02c-b109518a917f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:18.380933 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-43ee867f-3d92-4051-a02c-b109518a917f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:18.409013 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-43ee867f-3d92-4051-a02c-b109518a917f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043885 Aug 19 16:36:18.409551 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 352/702] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:36:18 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:19.003158 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-104b3e48-a3eb-4676-8dba-67681143d3da tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:19.003796 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-104b3e48-a3eb-4676-8dba-67681143d3da tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:19.010221 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-104b3e48-a3eb-4676-8dba-67681143d3da tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:19.010693 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-104b3e48-a3eb-4676-8dba-67681143d3da tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:19.011129 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-104b3e48-a3eb-4676-8dba-67681143d3da tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:19.011803 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-104b3e48-a3eb-4676-8dba-67681143d3da tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:19.012250 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-104b3e48-a3eb-4676-8dba-67681143d3da tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:19.012668 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-104b3e48-a3eb-4676-8dba-67681143d3da tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:19.141085 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-104b3e48-a3eb-4676-8dba-67681143d3da tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:19.149732 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-104b3e48-a3eb-4676-8dba-67681143d3da tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.150375 Aug 19 16:36:19.154331 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 351/703] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:18 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:19.420950 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8bbe5e57-66b9-4470-b5e4-c7176bbbb849 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:19.423169 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8bbe5e57-66b9-4470-b5e4-c7176bbbb849 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:19.430060 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8bbe5e57-66b9-4470-b5e4-c7176bbbb849 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:19.430538 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8bbe5e57-66b9-4470-b5e4-c7176bbbb849 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:19.430968 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8bbe5e57-66b9-4470-b5e4-c7176bbbb849 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:19.431682 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8bbe5e57-66b9-4470-b5e4-c7176bbbb849 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:19.432128 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8bbe5e57-66b9-4470-b5e4-c7176bbbb849 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:19.432605 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8bbe5e57-66b9-4470-b5e4-c7176bbbb849 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:19.462105 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8bbe5e57-66b9-4470-b5e4-c7176bbbb849 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045099 Aug 19 16:36:19.462656 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 353/704] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:36:19 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:20.170925 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6804d906-6db2-4b86-820e-2fac32e68b9c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:20.171537 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6804d906-6db2-4b86-820e-2fac32e68b9c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:20.177919 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6804d906-6db2-4b86-820e-2fac32e68b9c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:20.178420 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6804d906-6db2-4b86-820e-2fac32e68b9c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:20.178856 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6804d906-6db2-4b86-820e-2fac32e68b9c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:20.179543 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6804d906-6db2-4b86-820e-2fac32e68b9c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:20.180014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6804d906-6db2-4b86-820e-2fac32e68b9c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:20.180435 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6804d906-6db2-4b86-820e-2fac32e68b9c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:20.306542 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6804d906-6db2-4b86-820e-2fac32e68b9c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:20.315412 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6804d906-6db2-4b86-820e-2fac32e68b9c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.148278 Aug 19 16:36:20.316005 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 352/705] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:20 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:20.474233 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a1560a10-ae83-4bce-b011-2219a42edd2c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:20.476799 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a1560a10-ae83-4bce-b011-2219a42edd2c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:20.485590 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a1560a10-ae83-4bce-b011-2219a42edd2c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:20.486076 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a1560a10-ae83-4bce-b011-2219a42edd2c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:20.486509 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a1560a10-ae83-4bce-b011-2219a42edd2c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:20.487509 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a1560a10-ae83-4bce-b011-2219a42edd2c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:20.487959 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a1560a10-ae83-4bce-b011-2219a42edd2c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:20.489445 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a1560a10-ae83-4bce-b011-2219a42edd2c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:20.520696 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a1560a10-ae83-4bce-b011-2219a42edd2c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050213 Aug 19 16:36:20.521275 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 354/706] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:36:20 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:21.337529 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-232f5275-0df6-4756-b7ed-c92a17db72e6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:21.338175 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-232f5275-0df6-4756-b7ed-c92a17db72e6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:21.344509 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-232f5275-0df6-4756-b7ed-c92a17db72e6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:21.345028 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-232f5275-0df6-4756-b7ed-c92a17db72e6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:21.345469 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-232f5275-0df6-4756-b7ed-c92a17db72e6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:21.346160 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-232f5275-0df6-4756-b7ed-c92a17db72e6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:21.346623 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-232f5275-0df6-4756-b7ed-c92a17db72e6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:21.347050 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-232f5275-0df6-4756-b7ed-c92a17db72e6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:21.476975 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-232f5275-0df6-4756-b7ed-c92a17db72e6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:21.485030 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-232f5275-0df6-4756-b7ed-c92a17db72e6 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.151433 Aug 19 16:36:21.485585 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 353/707] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:21 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:21.532675 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-6c0d277b-90be-442e-81d1-c5a962bcc8a2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:21.534972 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-6c0d277b-90be-442e-81d1-c5a962bcc8a2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:21.542109 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6c0d277b-90be-442e-81d1-c5a962bcc8a2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:21.542590 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6c0d277b-90be-442e-81d1-c5a962bcc8a2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:21.543017 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6c0d277b-90be-442e-81d1-c5a962bcc8a2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:21.543700 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6c0d277b-90be-442e-81d1-c5a962bcc8a2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:21.544144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6c0d277b-90be-442e-81d1-c5a962bcc8a2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:21.544563 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6c0d277b-90be-442e-81d1-c5a962bcc8a2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:21.574916 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-6c0d277b-90be-442e-81d1-c5a962bcc8a2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046106 Aug 19 16:36:21.575729 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 355/708] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:36:21 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:22.224116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-5691331c-e4a3-433d-aff6-4af953d3434f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:22.224898 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-5691331c-e4a3-433d-aff6-4af953d3434f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:22.230836 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5691331c-e4a3-433d-aff6-4af953d3434f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:22.231319 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5691331c-e4a3-433d-aff6-4af953d3434f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:22.231755 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5691331c-e4a3-433d-aff6-4af953d3434f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:22.232447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5691331c-e4a3-433d-aff6-4af953d3434f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:22.232966 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5691331c-e4a3-433d-aff6-4af953d3434f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:22.233386 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5691331c-e4a3-433d-aff6-4af953d3434f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:22.364157 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5691331c-e4a3-433d-aff6-4af953d3434f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:22.372423 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-5691331c-e4a3-433d-aff6-4af953d3434f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1593 microversion: 2.1 time: 0.152725 Aug 19 16:36:22.373016 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 354/709] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:22 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1593 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:22.507246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e020f120-3362-4752-819d-62ab32d53300 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:22.507848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-e020f120-3362-4752-819d-62ab32d53300 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:22.513700 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e020f120-3362-4752-819d-62ab32d53300 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:22.514173 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e020f120-3362-4752-819d-62ab32d53300 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:22.514612 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e020f120-3362-4752-819d-62ab32d53300 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:22.515297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e020f120-3362-4752-819d-62ab32d53300 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:22.515739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e020f120-3362-4752-819d-62ab32d53300 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:22.516153 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e020f120-3362-4752-819d-62ab32d53300 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:22.588112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-bd2440c8-1b19-4541-8689-3dcd59bfab49 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:22.590407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-bd2440c8-1b19-4541-8689-3dcd59bfab49 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:22.596253 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bd2440c8-1b19-4541-8689-3dcd59bfab49 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:22.596743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bd2440c8-1b19-4541-8689-3dcd59bfab49 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:22.597212 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bd2440c8-1b19-4541-8689-3dcd59bfab49 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:22.598067 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bd2440c8-1b19-4541-8689-3dcd59bfab49 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:22.598695 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bd2440c8-1b19-4541-8689-3dcd59bfab49 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:22.599133 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bd2440c8-1b19-4541-8689-3dcd59bfab49 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:22.632806 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-bd2440c8-1b19-4541-8689-3dcd59bfab49 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048589 Aug 19 16:36:22.633589 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 355/710] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:36:22 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:22.652267 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-5832c062-af32-411c-9559-e336e303e417 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:22.652778 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-5832c062-af32-411c-9559-e336e303e417 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:22.659991 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5832c062-af32-411c-9559-e336e303e417 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:22.660989 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5832c062-af32-411c-9559-e336e303e417 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:22.661686 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5832c062-af32-411c-9559-e336e303e417 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:22.662401 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5832c062-af32-411c-9559-e336e303e417 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:22.662910 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5832c062-af32-411c-9559-e336e303e417 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:22.663376 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5832c062-af32-411c-9559-e336e303e417 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:22.737575 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e020f120-3362-4752-819d-62ab32d53300 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:22.747463 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e020f120-3362-4752-819d-62ab32d53300 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.244527 Aug 19 16:36:22.748291 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 356/711] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:22 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:22.752915 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.objects.instance [None req-5832c062-af32-411c-9559-e336e303e417 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lazy-loading 'services' on Instance uuid c18cbc3d-cc71-4f92-b80f-8d75547d8e34 {{(pid=127285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:36:22.823544 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:22.838249 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-5832c062-af32-411c-9559-e336e303e417 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "DELETE /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34/os-volume_attachments/54803636-eaa3-4d8e-ba59-e35102db3fa6" status: 202 len: 0 microversion: 2.1 time: 0.190047 Aug 19 16:36:22.839168 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 356/712] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Aug 19 16:36:22 2022] DELETE /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34/os-volume_attachments/54803636-eaa3-4d8e-ba59-e35102db3fa6 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:36:23.645457 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e4c75416-59c2-4543-9097-17fc4e1f1338 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:23.647683 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-e4c75416-59c2-4543-9097-17fc4e1f1338 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:23.654247 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e4c75416-59c2-4543-9097-17fc4e1f1338 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:23.654959 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e4c75416-59c2-4543-9097-17fc4e1f1338 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:23.655393 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e4c75416-59c2-4543-9097-17fc4e1f1338 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:23.656090 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e4c75416-59c2-4543-9097-17fc4e1f1338 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:23.656536 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e4c75416-59c2-4543-9097-17fc4e1f1338 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:23.656977 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e4c75416-59c2-4543-9097-17fc4e1f1338 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:23.686240 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e4c75416-59c2-4543-9097-17fc4e1f1338 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044634 Aug 19 16:36:23.686760 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 357/713] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:36:23 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 16:36:23.751554 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0c31c16d-b006-4567-9b3c-99b4b4590fef tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:23.752359 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-0c31c16d-b006-4567-9b3c-99b4b4590fef tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:23.758980 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0c31c16d-b006-4567-9b3c-99b4b4590fef tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:23.759475 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0c31c16d-b006-4567-9b3c-99b4b4590fef tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:23.759901 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0c31c16d-b006-4567-9b3c-99b4b4590fef tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:23.760598 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0c31c16d-b006-4567-9b3c-99b4b4590fef tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:23.761084 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0c31c16d-b006-4567-9b3c-99b4b4590fef tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:23.761511 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0c31c16d-b006-4567-9b3c-99b4b4590fef tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:23.775349 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f0fc2212-7680-40bd-81f0-7ced9272ecbb tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:23.776476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f0fc2212-7680-40bd-81f0-7ced9272ecbb tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:23.786915 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f0fc2212-7680-40bd-81f0-7ced9272ecbb tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:23.787683 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f0fc2212-7680-40bd-81f0-7ced9272ecbb tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:23.788129 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f0fc2212-7680-40bd-81f0-7ced9272ecbb tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:23.788873 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f0fc2212-7680-40bd-81f0-7ced9272ecbb tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:23.789950 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f0fc2212-7680-40bd-81f0-7ced9272ecbb tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:23.790389 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f0fc2212-7680-40bd-81f0-7ced9272ecbb tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:23.790519 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-0c31c16d-b006-4567-9b3c-99b4b4590fef tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Going to try to terminate instance {{(pid=127285) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:36:23.873876 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-0c31c16d-b006-4567-9b3c-99b4b4590fef tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 204 len: 0 microversion: 2.1 time: 0.127349 Aug 19 16:36:23.874718 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 357/714] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:36:23 2022] DELETE /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 19 16:36:23.884395 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-44639105-f453-4adf-8073-817c5a19cd99 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:23.885361 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-44639105-f453-4adf-8073-817c5a19cd99 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:23.892125 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-44639105-f453-4adf-8073-817c5a19cd99 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:23.892614 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-44639105-f453-4adf-8073-817c5a19cd99 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:23.893128 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-44639105-f453-4adf-8073-817c5a19cd99 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:23.893824 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-44639105-f453-4adf-8073-817c5a19cd99 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:23.894319 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-44639105-f453-4adf-8073-817c5a19cd99 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:23.895074 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-44639105-f453-4adf-8073-817c5a19cd99 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:24.035770 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-44639105-f453-4adf-8073-817c5a19cd99 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:24.043875 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-44639105-f453-4adf-8073-817c5a19cd99 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1678 microversion: 2.1 time: 0.164111 Aug 19 16:36:24.044544 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 358/715] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:23 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:36:24.057254 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f0fc2212-7680-40bd-81f0-7ced9272ecbb tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:24.066259 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f0fc2212-7680-40bd-81f0-7ced9272ecbb tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.296139 Aug 19 16:36:24.067013 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 358/716] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:23 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:36:24.432081 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-2b5302bf-f559-4cb3-b2d1-688094bc10f6 req-55dd2ffd-1583-47ef-a422-754664749190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4034526-7330-4541-a2cb-d646a572d9d8", "tag": "498a3f32-b577-44b6-8701-625d4a4962ec"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:36:24.442894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-2b5302bf-f559-4cb3-b2d1-688094bc10f6 req-55dd2ffd-1583-47ef-a422-754664749190 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:24.443874 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-2b5302bf-f559-4cb3-b2d1-688094bc10f6 req-55dd2ffd-1583-47ef-a422-754664749190 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:24.444485 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-2b5302bf-f559-4cb3-b2d1-688094bc10f6 req-55dd2ffd-1583-47ef-a422-754664749190 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:24.457545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-2b5302bf-f559-4cb3-b2d1-688094bc10f6 req-55dd2ffd-1583-47ef-a422-754664749190 service nova] Creating event network-changed:498a3f32-b577-44b6-8701-625d4a4962ec for instance d4034526-7330-4541-a2cb-d646a572d9d8 on hv-cinder-83124 Aug 19 16:36:24.463186 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-2b5302bf-f559-4cb3-b2d1-688094bc10f6 req-55dd2ffd-1583-47ef-a422-754664749190 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034935 Aug 19 16:36:24.463356 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 359/717] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:25.031931 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d34c0fb6-0721-46e0-bbe7-c1783b70a3a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:25.032508 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d34c0fb6-0721-46e0-bbe7-c1783b70a3a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:25.040087 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d34c0fb6-0721-46e0-bbe7-c1783b70a3a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:25.040575 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d34c0fb6-0721-46e0-bbe7-c1783b70a3a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:25.041630 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d34c0fb6-0721-46e0-bbe7-c1783b70a3a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:25.041787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d34c0fb6-0721-46e0-bbe7-c1783b70a3a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:25.042175 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d34c0fb6-0721-46e0-bbe7-c1783b70a3a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:25.042594 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d34c0fb6-0721-46e0-bbe7-c1783b70a3a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:25.067760 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c917e2dc-3c2c-4fd1-87cc-a4a9ffadad4d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:25.069152 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c917e2dc-3c2c-4fd1-87cc-a4a9ffadad4d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:25.073175 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d34c0fb6-0721-46e0-bbe7-c1783b70a3a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Going to try to terminate instance {{(pid=127284) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:36:25.076311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c917e2dc-3c2c-4fd1-87cc-a4a9ffadad4d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:25.077174 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c917e2dc-3c2c-4fd1-87cc-a4a9ffadad4d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:25.077627 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c917e2dc-3c2c-4fd1-87cc-a4a9ffadad4d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:25.078296 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c917e2dc-3c2c-4fd1-87cc-a4a9ffadad4d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:25.078748 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c917e2dc-3c2c-4fd1-87cc-a4a9ffadad4d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:25.079162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c917e2dc-3c2c-4fd1-87cc-a4a9ffadad4d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:25.172816 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d34c0fb6-0721-46e0-bbe7-c1783b70a3a7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "DELETE /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 204 len: 0 microversion: 2.1 time: 0.144231 Aug 19 16:36:25.173833 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 359/718] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:36:25 2022] DELETE /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:36:25.188968 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-3fbe0986-9a13-4651-bba2-53fef0adaacd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:25.189674 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-3fbe0986-9a13-4651-bba2-53fef0adaacd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:25.198524 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3fbe0986-9a13-4651-bba2-53fef0adaacd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:25.199303 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3fbe0986-9a13-4651-bba2-53fef0adaacd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:25.200455 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3fbe0986-9a13-4651-bba2-53fef0adaacd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:25.201395 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3fbe0986-9a13-4651-bba2-53fef0adaacd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:25.202004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3fbe0986-9a13-4651-bba2-53fef0adaacd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:25.202583 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3fbe0986-9a13-4651-bba2-53fef0adaacd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:25.239101 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c917e2dc-3c2c-4fd1-87cc-a4a9ffadad4d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:25.247970 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c917e2dc-3c2c-4fd1-87cc-a4a9ffadad4d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1678 microversion: 2.1 time: 0.185329 Aug 19 16:36:25.249687 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 360/719] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:25 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:36:25.257190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1f0813d5-89d4-471d-baba-86f9a46ff648 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:25.258141 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-1f0813d5-89d4-471d-baba-86f9a46ff648 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:25.264411 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1f0813d5-89d4-471d-baba-86f9a46ff648 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:25.265229 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1f0813d5-89d4-471d-baba-86f9a46ff648 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:25.265760 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1f0813d5-89d4-471d-baba-86f9a46ff648 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:25.266558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1f0813d5-89d4-471d-baba-86f9a46ff648 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:25.267101 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1f0813d5-89d4-471d-baba-86f9a46ff648 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:25.267621 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1f0813d5-89d4-471d-baba-86f9a46ff648 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:25.410889 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-3fbe0986-9a13-4651-bba2-53fef0adaacd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:25.415819 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:25.423980 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1f0813d5-89d4-471d-baba-86f9a46ff648 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:25.424844 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-3fbe0986-9a13-4651-bba2-53fef0adaacd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.247125 Aug 19 16:36:25.426925 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 360/720] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:25 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:25.455356 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-1f0813d5-89d4-471d-baba-86f9a46ff648 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1560 microversion: 2.1 time: 0.204349 Aug 19 16:36:25.456224 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 361/721] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:25 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1560 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:25.532167 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-64c330fd-f176-4a1e-93eb-e822f32646d0 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-886385740"}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:36:25.532711 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-64c330fd-f176-4a1e-93eb-e822f32646d0 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:25.540192 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-64c330fd-f176-4a1e-93eb-e822f32646d0 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:25.540680 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-64c330fd-f176-4a1e-93eb-e822f32646d0 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:25.541145 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-64c330fd-f176-4a1e-93eb-e822f32646d0 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:25.541843 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-64c330fd-f176-4a1e-93eb-e822f32646d0 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:25.542293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-64c330fd-f176-4a1e-93eb-e822f32646d0 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:25.542716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-64c330fd-f176-4a1e-93eb-e822f32646d0 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:25.673892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.network.security_group_api [None req-64c330fd-f176-4a1e-93eb-e822f32646d0 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Adding security group 4162fe98-9f09-4018-8583-028120981944 to port 498a3f32-b577-44b6-8701-625d4a4962ec Aug 19 16:36:25.994455 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-64c330fd-f176-4a1e-93eb-e822f32646d0 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "POST /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/action" status: 202 len: 0 microversion: 2.1 time: 0.467323 Aug 19 16:36:25.995073 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 361/722] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Aug 19 16:36:25 2022] POST /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:36:26.004278 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-cbfd228a-ca89-419d-b7ca-43fe96126009 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:26.004940 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-cbfd228a-ca89-419d-b7ca-43fe96126009 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:26.010829 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cbfd228a-ca89-419d-b7ca-43fe96126009 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:26.011310 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cbfd228a-ca89-419d-b7ca-43fe96126009 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:26.011739 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cbfd228a-ca89-419d-b7ca-43fe96126009 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:26.012427 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cbfd228a-ca89-419d-b7ca-43fe96126009 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:26.012909 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cbfd228a-ca89-419d-b7ca-43fe96126009 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:26.013333 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cbfd228a-ca89-419d-b7ca-43fe96126009 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:26.161474 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-cbfd228a-ca89-419d-b7ca-43fe96126009 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:26.169948 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-cbfd228a-ca89-419d-b7ca-43fe96126009 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1639 microversion: 2.1 time: 0.170573 Aug 19 16:36:26.170645 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 362/723] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:25 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1639 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:26.274443 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-fa2a5c26-ff8b-49df-9e1b-78505da7d0e3 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:26.274988 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-fa2a5c26-ff8b-49df-9e1b-78505da7d0e3 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:26.280820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fa2a5c26-ff8b-49df-9e1b-78505da7d0e3 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:26.281296 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fa2a5c26-ff8b-49df-9e1b-78505da7d0e3 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:26.281724 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fa2a5c26-ff8b-49df-9e1b-78505da7d0e3 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:26.282401 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fa2a5c26-ff8b-49df-9e1b-78505da7d0e3 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:26.282863 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fa2a5c26-ff8b-49df-9e1b-78505da7d0e3 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:26.283292 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fa2a5c26-ff8b-49df-9e1b-78505da7d0e3 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:26.427219 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-fa2a5c26-ff8b-49df-9e1b-78505da7d0e3 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:26.434796 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-fa2a5c26-ff8b-49df-9e1b-78505da7d0e3 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1678 microversion: 2.1 time: 0.164874 Aug 19 16:36:26.435358 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 362/724] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:26 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:26.455355 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4b329e9a-27b6-4f53-bdb4-f787a3225cad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:26.455966 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-4b329e9a-27b6-4f53-bdb4-f787a3225cad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:26.462450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4b329e9a-27b6-4f53-bdb4-f787a3225cad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:26.462931 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4b329e9a-27b6-4f53-bdb4-f787a3225cad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:26.463364 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4b329e9a-27b6-4f53-bdb4-f787a3225cad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:26.464059 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4b329e9a-27b6-4f53-bdb4-f787a3225cad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:26.464515 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4b329e9a-27b6-4f53-bdb4-f787a3225cad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:26.464975 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4b329e9a-27b6-4f53-bdb4-f787a3225cad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:26.478814 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-87a3f5dd-692a-448c-b9e0-35d225d8ce57 req-d9fcfac7-a405-4eb5-8001-d584d6e52053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4034526-7330-4541-a2cb-d646a572d9d8", "tag": "498a3f32-b577-44b6-8701-625d4a4962ec"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:36:26.488277 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-87a3f5dd-692a-448c-b9e0-35d225d8ce57 req-d9fcfac7-a405-4eb5-8001-d584d6e52053 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:26.488943 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-87a3f5dd-692a-448c-b9e0-35d225d8ce57 req-d9fcfac7-a405-4eb5-8001-d584d6e52053 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:26.489462 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-87a3f5dd-692a-448c-b9e0-35d225d8ce57 req-d9fcfac7-a405-4eb5-8001-d584d6e52053 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:26.501144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-87a3f5dd-692a-448c-b9e0-35d225d8ce57 req-d9fcfac7-a405-4eb5-8001-d584d6e52053 service nova] Creating event network-changed:498a3f32-b577-44b6-8701-625d4a4962ec for instance d4034526-7330-4541-a2cb-d646a572d9d8 on hv-cinder-83124 Aug 19 16:36:26.506062 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-87a3f5dd-692a-448c-b9e0-35d225d8ce57 req-d9fcfac7-a405-4eb5-8001-d584d6e52053 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030828 Aug 19 16:36:26.506772 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 363/725] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:36:26.514964 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8223ce14-7680-4e17-93c3-70884922ed3a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:26.515736 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8223ce14-7680-4e17-93c3-70884922ed3a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:26.522486 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8223ce14-7680-4e17-93c3-70884922ed3a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:26.523044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8223ce14-7680-4e17-93c3-70884922ed3a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:26.523538 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8223ce14-7680-4e17-93c3-70884922ed3a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:26.524290 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8223ce14-7680-4e17-93c3-70884922ed3a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:26.524901 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8223ce14-7680-4e17-93c3-70884922ed3a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:26.525358 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8223ce14-7680-4e17-93c3-70884922ed3a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:26.608931 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-4b329e9a-27b6-4f53-bdb4-f787a3225cad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:26.617468 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4b329e9a-27b6-4f53-bdb4-f787a3225cad tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.165874 Aug 19 16:36:26.618451 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 363/726] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:26 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:26.700895 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8223ce14-7680-4e17-93c3-70884922ed3a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:26.708645 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8223ce14-7680-4e17-93c3-70884922ed3a tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1514 microversion: 2.1 time: 0.197705 Aug 19 16:36:26.709256 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 364/727] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:26 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:27.456175 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-9f667c28-6259-491c-8ec1-49601c6fbcf2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:27.457581 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-9f667c28-6259-491c-8ec1-49601c6fbcf2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:27.464089 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f667c28-6259-491c-8ec1-49601c6fbcf2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:27.464577 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f667c28-6259-491c-8ec1-49601c6fbcf2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:27.465050 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f667c28-6259-491c-8ec1-49601c6fbcf2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:27.465743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f667c28-6259-491c-8ec1-49601c6fbcf2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:27.466197 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f667c28-6259-491c-8ec1-49601c6fbcf2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:27.466621 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f667c28-6259-491c-8ec1-49601c6fbcf2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:27.594726 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-9f667c28-6259-491c-8ec1-49601c6fbcf2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:27.602651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-9f667c28-6259-491c-8ec1-49601c6fbcf2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1678 microversion: 2.1 time: 0.150348 Aug 19 16:36:27.603218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 364/728] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:27 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:27.639315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-255ada90-e67f-48f7-a47a-90d033ea7612 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:27.639917 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-255ada90-e67f-48f7-a47a-90d033ea7612 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:27.647071 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-255ada90-e67f-48f7-a47a-90d033ea7612 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:27.647557 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-255ada90-e67f-48f7-a47a-90d033ea7612 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:27.647976 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-255ada90-e67f-48f7-a47a-90d033ea7612 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:27.648659 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-255ada90-e67f-48f7-a47a-90d033ea7612 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:27.649199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-255ada90-e67f-48f7-a47a-90d033ea7612 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:27.649619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-255ada90-e67f-48f7-a47a-90d033ea7612 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:27.729528 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-843bae85-00ec-41d4-959c-7486a9acb375 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:27.730135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-843bae85-00ec-41d4-959c-7486a9acb375 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:27.736002 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-843bae85-00ec-41d4-959c-7486a9acb375 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:27.736482 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-843bae85-00ec-41d4-959c-7486a9acb375 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:27.736950 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-843bae85-00ec-41d4-959c-7486a9acb375 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:27.737640 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-843bae85-00ec-41d4-959c-7486a9acb375 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:27.738121 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-843bae85-00ec-41d4-959c-7486a9acb375 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:27.738746 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-843bae85-00ec-41d4-959c-7486a9acb375 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:27.780655 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-255ada90-e67f-48f7-a47a-90d033ea7612 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:27.789375 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-255ada90-e67f-48f7-a47a-90d033ea7612 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.153893 Aug 19 16:36:27.789946 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 365/729] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:27 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:27.869774 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-843bae85-00ec-41d4-959c-7486a9acb375 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:27.877427 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-843bae85-00ec-41d4-959c-7486a9acb375 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1514 microversion: 2.1 time: 0.151894 Aug 19 16:36:27.877975 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 365/730] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:27 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:36:28.623475 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-3620e5ea-f3d4-4568-8d70-3985e4ef1407 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:28.624108 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-3620e5ea-f3d4-4568-8d70-3985e4ef1407 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:28.631270 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3620e5ea-f3d4-4568-8d70-3985e4ef1407 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:28.631434 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3620e5ea-f3d4-4568-8d70-3985e4ef1407 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:28.631842 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3620e5ea-f3d4-4568-8d70-3985e4ef1407 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:28.632530 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3620e5ea-f3d4-4568-8d70-3985e4ef1407 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:28.633017 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3620e5ea-f3d4-4568-8d70-3985e4ef1407 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:28.633437 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3620e5ea-f3d4-4568-8d70-3985e4ef1407 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:28.766630 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-3620e5ea-f3d4-4568-8d70-3985e4ef1407 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:28.774813 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-3620e5ea-f3d4-4568-8d70-3985e4ef1407 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1678 microversion: 2.1 time: 0.155219 Aug 19 16:36:28.775519 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 366/731] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:28 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:28.810602 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-23173b95-0f39-4679-ac20-c835ac1ad242 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:28.811216 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-23173b95-0f39-4679-ac20-c835ac1ad242 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:28.818170 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-23173b95-0f39-4679-ac20-c835ac1ad242 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:28.818653 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-23173b95-0f39-4679-ac20-c835ac1ad242 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:28.819090 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-23173b95-0f39-4679-ac20-c835ac1ad242 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:28.819783 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-23173b95-0f39-4679-ac20-c835ac1ad242 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:28.820238 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-23173b95-0f39-4679-ac20-c835ac1ad242 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:28.820664 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-23173b95-0f39-4679-ac20-c835ac1ad242 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:28.899626 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a7a657fa-d7bb-4cac-9e76-a03e196ee007 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:28.900241 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a7a657fa-d7bb-4cac-9e76-a03e196ee007 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:28.908783 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a7a657fa-d7bb-4cac-9e76-a03e196ee007 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:28.909270 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a7a657fa-d7bb-4cac-9e76-a03e196ee007 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:28.910706 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a7a657fa-d7bb-4cac-9e76-a03e196ee007 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:28.911680 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a7a657fa-d7bb-4cac-9e76-a03e196ee007 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:28.912144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a7a657fa-d7bb-4cac-9e76-a03e196ee007 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:28.912575 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a7a657fa-d7bb-4cac-9e76-a03e196ee007 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:28.968876 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-23173b95-0f39-4679-ac20-c835ac1ad242 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:28.978451 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-23173b95-0f39-4679-ac20-c835ac1ad242 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.171670 Aug 19 16:36:28.979344 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 366/732] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:28 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:29.079801 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a7a657fa-d7bb-4cac-9e76-a03e196ee007 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:29.088222 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a7a657fa-d7bb-4cac-9e76-a03e196ee007 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1514 microversion: 2.1 time: 0.192532 Aug 19 16:36:29.088796 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 367/733] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:28 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:36:29.796706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ffff9d2a-3727-4c00-b4e2-b35db2af71b6 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:29.797452 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ffff9d2a-3727-4c00-b4e2-b35db2af71b6 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:29.804150 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ffff9d2a-3727-4c00-b4e2-b35db2af71b6 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:29.804651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ffff9d2a-3727-4c00-b4e2-b35db2af71b6 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:29.805121 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ffff9d2a-3727-4c00-b4e2-b35db2af71b6 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:29.805814 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ffff9d2a-3727-4c00-b4e2-b35db2af71b6 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:29.806262 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ffff9d2a-3727-4c00-b4e2-b35db2af71b6 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:29.806686 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ffff9d2a-3727-4c00-b4e2-b35db2af71b6 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:29.869050 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ffff9d2a-3727-4c00-b4e2-b35db2af71b6 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:29.877293 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ffff9d2a-3727-4c00-b4e2-b35db2af71b6 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1611 microversion: 2.1 time: 0.084377 Aug 19 16:36:29.877876 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 367/734] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:29 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1611 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:29.999528 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1812ec54-ac9a-410a-905b-3297befc2eac tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:30.001833 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1812ec54-ac9a-410a-905b-3297befc2eac tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:30.008483 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1812ec54-ac9a-410a-905b-3297befc2eac tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:30.009002 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1812ec54-ac9a-410a-905b-3297befc2eac tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:30.009434 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1812ec54-ac9a-410a-905b-3297befc2eac tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:30.010130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1812ec54-ac9a-410a-905b-3297befc2eac tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:30.010576 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1812ec54-ac9a-410a-905b-3297befc2eac tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:30.010992 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1812ec54-ac9a-410a-905b-3297befc2eac tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:30.109702 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-46c71d93-cbe4-41e0-abd6-8fe53d9de9ff tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:30.110322 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-46c71d93-cbe4-41e0-abd6-8fe53d9de9ff tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:30.117206 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-46c71d93-cbe4-41e0-abd6-8fe53d9de9ff tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:30.117706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-46c71d93-cbe4-41e0-abd6-8fe53d9de9ff tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:30.118144 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-46c71d93-cbe4-41e0-abd6-8fe53d9de9ff tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:30.119068 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-46c71d93-cbe4-41e0-abd6-8fe53d9de9ff tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:30.119530 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-46c71d93-cbe4-41e0-abd6-8fe53d9de9ff tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:30.119959 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-46c71d93-cbe4-41e0-abd6-8fe53d9de9ff tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:30.274543 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-46c71d93-cbe4-41e0-abd6-8fe53d9de9ff tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:30.277635 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1812ec54-ac9a-410a-905b-3297befc2eac tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:30.289448 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-46c71d93-cbe4-41e0-abd6-8fe53d9de9ff tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1514 microversion: 2.1 time: 0.183486 Aug 19 16:36:30.289672 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1812ec54-ac9a-410a-905b-3297befc2eac tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.293755 Aug 19 16:36:30.290032 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 368/735] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:29 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:30.290570 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 368/736] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:30 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:36:30.308115 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-33d32320-1d23-44b1-96bb-12dbd3b4a0d1 req-688bd210-0152-4445-8497-de0a7cc199cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1f3d4e-7c83-4d2b-a34f-4cac4b871285", "name": "network-vif-deleted", "tag": "36d1a484-663f-4e9f-a220-92a99deec85f"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:36:30.318434 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-33d32320-1d23-44b1-96bb-12dbd3b4a0d1 req-688bd210-0152-4445-8497-de0a7cc199cf service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:30.318906 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-33d32320-1d23-44b1-96bb-12dbd3b4a0d1 req-688bd210-0152-4445-8497-de0a7cc199cf service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:30.319333 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-33d32320-1d23-44b1-96bb-12dbd3b4a0d1 req-688bd210-0152-4445-8497-de0a7cc199cf service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:30.330322 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-33d32320-1d23-44b1-96bb-12dbd3b4a0d1 req-688bd210-0152-4445-8497-de0a7cc199cf service nova] Creating event network-vif-deleted:36d1a484-663f-4e9f-a220-92a99deec85f for instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 on hv-cinder-83124 Aug 19 16:36:30.336245 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-33d32320-1d23-44b1-96bb-12dbd3b4a0d1 req-688bd210-0152-4445-8497-de0a7cc199cf service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031734 Aug 19 16:36:30.336871 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 369/737] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:30.899027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c41c972a-0ff0-4b3c-a562-8821758d4620 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:30.899638 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c41c972a-0ff0-4b3c-a562-8821758d4620 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:30.906431 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c41c972a-0ff0-4b3c-a562-8821758d4620 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:30.906914 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c41c972a-0ff0-4b3c-a562-8821758d4620 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:30.907348 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c41c972a-0ff0-4b3c-a562-8821758d4620 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:30.908042 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c41c972a-0ff0-4b3c-a562-8821758d4620 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:30.908695 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c41c972a-0ff0-4b3c-a562-8821758d4620 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:30.909328 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c41c972a-0ff0-4b3c-a562-8821758d4620 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:30.944404 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c41c972a-0ff0-4b3c-a562-8821758d4620 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:30.945126 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c41c972a-0ff0-4b3c-a562-8821758d4620 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:30.945679 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c41c972a-0ff0-4b3c-a562-8821758d4620 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:30.946284 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.objects.instance [None req-c41c972a-0ff0-4b3c-a562-8821758d4620 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lazy-loading 'fault' on Instance uuid 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 {{(pid=127285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:36:30.995721 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c41c972a-0ff0-4b3c-a562-8821758d4620 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:31.003923 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c41c972a-0ff0-4b3c-a562-8821758d4620 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 200 len: 1329 microversion: 2.1 time: 0.108298 Aug 19 16:36:31.004572 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 369/738] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:30 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 1329 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:31.205902 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-3ca5b7ca-e307-4c72-a2ac-e76b27eec4aa req-011289fd-0eb9-462c-828f-e9e7b28bd957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c18cbc3d-cc71-4f92-b80f-8d75547d8e34", "name": "network-vif-deleted", "tag": "726cac17-7761-4611-aa5f-2dce23965fa9"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:36:31.210713 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:31.218047 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-3ca5b7ca-e307-4c72-a2ac-e76b27eec4aa req-011289fd-0eb9-462c-828f-e9e7b28bd957 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:31.218819 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-3ca5b7ca-e307-4c72-a2ac-e76b27eec4aa req-011289fd-0eb9-462c-828f-e9e7b28bd957 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:31.219393 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-3ca5b7ca-e307-4c72-a2ac-e76b27eec4aa req-011289fd-0eb9-462c-828f-e9e7b28bd957 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:31.234057 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-3ca5b7ca-e307-4c72-a2ac-e76b27eec4aa req-011289fd-0eb9-462c-828f-e9e7b28bd957 service nova] Creating event network-vif-deleted:726cac17-7761-4611-aa5f-2dce23965fa9 for instance c18cbc3d-cc71-4f92-b80f-8d75547d8e34 on hv-cinder-83124 Aug 19 16:36:31.240819 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-3ca5b7ca-e307-4c72-a2ac-e76b27eec4aa req-011289fd-0eb9-462c-828f-e9e7b28bd957 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039236 Aug 19 16:36:31.242198 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 370/739] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:31.311608 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-06a2ad4f-f08a-455c-bc14-99f428cb1808 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:31.312386 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-06a2ad4f-f08a-455c-bc14-99f428cb1808 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:31.312542 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a0e9379e-6f88-4768-bfc6-57b8022f95e7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:31.313179 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a0e9379e-6f88-4768-bfc6-57b8022f95e7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:31.320031 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06a2ad4f-f08a-455c-bc14-99f428cb1808 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:31.320516 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06a2ad4f-f08a-455c-bc14-99f428cb1808 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:31.320682 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a0e9379e-6f88-4768-bfc6-57b8022f95e7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:31.320986 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06a2ad4f-f08a-455c-bc14-99f428cb1808 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:31.321382 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a0e9379e-6f88-4768-bfc6-57b8022f95e7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:31.321680 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06a2ad4f-f08a-455c-bc14-99f428cb1808 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:31.321811 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a0e9379e-6f88-4768-bfc6-57b8022f95e7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:31.322166 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06a2ad4f-f08a-455c-bc14-99f428cb1808 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:31.322675 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a0e9379e-6f88-4768-bfc6-57b8022f95e7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:31.322780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06a2ad4f-f08a-455c-bc14-99f428cb1808 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:31.323123 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a0e9379e-6f88-4768-bfc6-57b8022f95e7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:31.323538 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a0e9379e-6f88-4768-bfc6-57b8022f95e7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:31.388701 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a0e9379e-6f88-4768-bfc6-57b8022f95e7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:31.404502 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a0e9379e-6f88-4768-bfc6-57b8022f95e7 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1304 microversion: 2.1 time: 0.096719 Aug 19 16:36:31.405235 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 371/740] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:31 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:31.458171 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-06a2ad4f-f08a-455c-bc14-99f428cb1808 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:31.466298 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-06a2ad4f-f08a-455c-bc14-99f428cb1808 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.159774 Aug 19 16:36:31.466857 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 370/741] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:31 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:32.025272 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1e91e8cd-f34a-440f-b846-608fd3969fbc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:32.025827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1e91e8cd-f34a-440f-b846-608fd3969fbc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:32.032083 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1e91e8cd-f34a-440f-b846-608fd3969fbc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:32.032570 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1e91e8cd-f34a-440f-b846-608fd3969fbc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:32.033058 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1e91e8cd-f34a-440f-b846-608fd3969fbc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:32.033747 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1e91e8cd-f34a-440f-b846-608fd3969fbc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:32.034197 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1e91e8cd-f34a-440f-b846-608fd3969fbc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:32.035113 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1e91e8cd-f34a-440f-b846-608fd3969fbc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:32.048582 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-1e91e8cd-f34a-440f-b846-608fd3969fbc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] HTTP exception thrown: Instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 could not be found. Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1e91e8cd-f34a-440f-b846-608fd3969fbc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Request method failure captured: Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 HTTP/1.1 Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7sAw9LcxO6N0pZY1nhZLJGTFHO5NOhvu1eVk6xTEodx-7uYGCVFosqHM2vYV2yCCDgERTbLEbTufj2duylmwK82XOJGkc69LfohAu5wx0GlI5NYAoHX6aVSGY0q6pl5_M_R0V-WnUvH1N5W6DXSAAPQV7ymDnRnchpgyuPHrFewp9k Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:36:32.051182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:36:32.052845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1743538991c8415394ac6cd5aed28d6a"}]}] Aug 19 16:36:32.052845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:36:32.052845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:36:32.052845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:36:32.052845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:36:32.052845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:36:32.052845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:36:32.052845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: 9b0455ae3ec94c929c940df6a0f6687d Aug 19 16:36:32.052845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:36:32.052845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:36:32.052845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 could not be found. Aug 19 16:36:32.052845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': '9f1f3d4e-7c83-4d2b-a34f-4cac4b871285'} Aug 19 16:36:32.053716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:36:32.053716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:36:32.053716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:36:32.053716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:36:32.053716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:36:32.053716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:36:32.053716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:36:32.053716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:36:32.053716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:36:32.053716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:36:32.053716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 could not be found. Aug 19 16:36:32.053716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:36:32.053716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:36:32.053716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:36:32.053716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:36:32.053716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:36:32.053716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:36:32.053716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:36:32.053716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:36:32.053716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:36:32.055130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:36:32.055130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:36:32.055130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:36:32.055130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:36:32.055130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:36:32.055130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:36:32.055130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:36:32.055130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 could not be found. Aug 19 16:36:32.055130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:36:32.055130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:36:32.055130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:36:32.055130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:36:32.055130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:36:32.055130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:36:32.055130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:36:32.055130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:36:32.055130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 could not be found. Aug 19 16:36:32.055130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:36:32.056412 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1e91e8cd-f34a-440f-b846-608fd3969fbc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Returning 404 to user: Instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:36:32.056412 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1e91e8cd-f34a-440f-b846-608fd3969fbc tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 404 len: 111 microversion: 2.1 time: 0.031021 Aug 19 16:36:32.056412 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 372/742] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:32 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:36:32.061163 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4a3a2312-4849-475b-a451-7a071170e1ae tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '.version_select at 0x7fb0228fd310>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:32.080694 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4a3a2312-4849-475b-a451-7a071170e1ae tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-252349643" status: 202 len: 0 microversion: 2.1 time: 0.023225 Aug 19 16:36:32.081528 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 371/743] 10.222.0.55 () {58 vars in 1218 bytes} [Fri Aug 19 16:36:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-252349643 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:36:32.429443 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-4fc2d515-880d-436a-9384-d13e11ed15c1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:32.430159 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-4fc2d515-880d-436a-9384-d13e11ed15c1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:32.437309 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4fc2d515-880d-436a-9384-d13e11ed15c1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:32.437970 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4fc2d515-880d-436a-9384-d13e11ed15c1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:32.438626 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4fc2d515-880d-436a-9384-d13e11ed15c1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:32.439711 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4fc2d515-880d-436a-9384-d13e11ed15c1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:32.440169 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4fc2d515-880d-436a-9384-d13e11ed15c1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:32.440828 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4fc2d515-880d-436a-9384-d13e11ed15c1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:32.476156 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4fc2d515-880d-436a-9384-d13e11ed15c1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:32.476645 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4fc2d515-880d-436a-9384-d13e11ed15c1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:32.477116 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4fc2d515-880d-436a-9384-d13e11ed15c1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:32.477567 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.objects.instance [None req-4fc2d515-880d-436a-9384-d13e11ed15c1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lazy-loading 'fault' on Instance uuid c18cbc3d-cc71-4f92-b80f-8d75547d8e34 {{(pid=127284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:36:32.487329 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b35b5f4d-a5b0-4368-83f9-87c19da44560 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:32.488118 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b35b5f4d-a5b0-4368-83f9-87c19da44560 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:32.494975 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b35b5f4d-a5b0-4368-83f9-87c19da44560 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:32.495452 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b35b5f4d-a5b0-4368-83f9-87c19da44560 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:32.495885 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b35b5f4d-a5b0-4368-83f9-87c19da44560 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:32.496572 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b35b5f4d-a5b0-4368-83f9-87c19da44560 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:32.497045 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b35b5f4d-a5b0-4368-83f9-87c19da44560 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:32.497467 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b35b5f4d-a5b0-4368-83f9-87c19da44560 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:32.542809 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-4fc2d515-880d-436a-9384-d13e11ed15c1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:32.550765 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-4fc2d515-880d-436a-9384-d13e11ed15c1 tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1309 microversion: 2.1 time: 0.128044 Aug 19 16:36:32.551572 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 373/744] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:32 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1309 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:32.634444 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b35b5f4d-a5b0-4368-83f9-87c19da44560 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:32.642999 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b35b5f4d-a5b0-4368-83f9-87c19da44560 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1734 microversion: 2.1 time: 0.159496 Aug 19 16:36:32.644478 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 372/745] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:32 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:36:32.760723 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1ae71a78-0114-42cb-b4c1-e9370bf423e7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Action: 'create', calling method: .version_select at 0x7fb01def9ca0>, body: {"keypair": {"name": "tempest-keypair-696143613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk1uyhD7k8GOnlPbW7Etz0zDqWtsAqcAkhSrOhtZQENAjlTg6C0iQvBYURRFA47snvMrBajZYE4Tp7m62J4eaAQylNDROIJzBw/PPu0+qxjAVFxpluqChCahj3eqfp4lQ=="}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:36:32.777474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-1ae71a78-0114-42cb-b4c1-e9370bf423e7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Getting quotas for project 1743538991c8415394ac6cd5aed28d6a. Resources: {'key_pairs'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:36:32.782518 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-1ae71a78-0114-42cb-b4c1-e9370bf423e7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Getting quotas for user 9b0455ae3ec94c929c940df6a0f6687d and project 1743538991c8415394ac6cd5aed28d6a. Resources: {'key_pairs'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:36:32.805913 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1ae71a78-0114-42cb-b4c1-e9370bf423e7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048977 Aug 19 16:36:32.806538 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 374/746] 10.222.0.55 () {60 vars in 1159 bytes} [Fri Aug 19 16:36:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:33.572324 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a881618d-9d66-4fd5-9d75-3f836bbf14da tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:33.572908 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a881618d-9d66-4fd5-9d75-3f836bbf14da tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:33.579589 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a881618d-9d66-4fd5-9d75-3f836bbf14da tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:33.580094 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a881618d-9d66-4fd5-9d75-3f836bbf14da tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:33.580938 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a881618d-9d66-4fd5-9d75-3f836bbf14da tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:33.582305 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a881618d-9d66-4fd5-9d75-3f836bbf14da tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:33.582764 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a881618d-9d66-4fd5-9d75-3f836bbf14da tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:33.583774 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a881618d-9d66-4fd5-9d75-3f836bbf14da tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:33.587674 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:33.623102 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a881618d-9d66-4fd5-9d75-3f836bbf14da tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:33.623606 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a881618d-9d66-4fd5-9d75-3f836bbf14da tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:33.624047 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a881618d-9d66-4fd5-9d75-3f836bbf14da tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:33.624573 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.objects.instance [None req-a881618d-9d66-4fd5-9d75-3f836bbf14da tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lazy-loading 'fault' on Instance uuid c18cbc3d-cc71-4f92-b80f-8d75547d8e34 {{(pid=127285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:36:33.666288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-9251d156-1706-4c81-a256-a3572fdf8918 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:33.667004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-9251d156-1706-4c81-a256-a3572fdf8918 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:33.671814 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a881618d-9d66-4fd5-9d75-3f836bbf14da tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e505bb350e4134976000a83bdd4fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c07333ddf4a19b35424d47d19dc60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:33.673918 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9251d156-1706-4c81-a256-a3572fdf8918 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:33.674657 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9251d156-1706-4c81-a256-a3572fdf8918 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:33.675208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9251d156-1706-4c81-a256-a3572fdf8918 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:33.675980 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9251d156-1706-4c81-a256-a3572fdf8918 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:33.676639 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9251d156-1706-4c81-a256-a3572fdf8918 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:33.677155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9251d156-1706-4c81-a256-a3572fdf8918 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:33.680772 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a881618d-9d66-4fd5-9d75-3f836bbf14da tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 200 len: 1309 microversion: 2.1 time: 0.112373 Aug 19 16:36:33.681440 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 373/747] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:33 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:33.880425 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-9251d156-1706-4c81-a256-a3572fdf8918 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:33.889703 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-9251d156-1706-4c81-a256-a3572fdf8918 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1714 microversion: 2.1 time: 0.227656 Aug 19 16:36:33.897746 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 375/748] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:33 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1714 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:36:34.014830 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d2951f15-7b4f-45cd-bc48-adc21c376b42 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:34.015326 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d2951f15-7b4f-45cd-bc48-adc21c376b42 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:34.022278 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2951f15-7b4f-45cd-bc48-adc21c376b42 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:34.022764 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2951f15-7b4f-45cd-bc48-adc21c376b42 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:34.023201 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2951f15-7b4f-45cd-bc48-adc21c376b42 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:34.023898 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2951f15-7b4f-45cd-bc48-adc21c376b42 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:34.024352 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2951f15-7b4f-45cd-bc48-adc21c376b42 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:34.024831 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2951f15-7b4f-45cd-bc48-adc21c376b42 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:34.113875 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-d2951f15-7b4f-45cd-bc48-adc21c376b42 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] HTTP exception thrown: Cannot 'detach_volume' instance 9ed4c246-7322-49b8-9bf7-2efaacc54b0b while it is in vm_state rescued Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d2951f15-7b4f-45cd-bc48-adc21c376b42 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Request method failure captured: Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: DELETE /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/os-volume_attachments/dc04bb90-55ba-4333-bf62-023881ec57ee HTTP/1.1 Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7sC2YMsastFwF5KHrblHGiieD2S6sdzYymMS54J0x8Vt4lT84xG-4lz_ihMmAVoylGBgEjsioBmjrEY0M57P2KMvM72KxZwA4DIrU64AxkuAJ1z0DkabuEtOI2EukBYULCeMuCjhjcFFPoj2rUEBN2R8sCo70cp1AnirNniwWFQth0 Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: b5638f78ab9440479a209d0023e6d0bd Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1328462527 Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:36:34.115935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:36:34.117571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b5638f78ab9440479a209d0023e6d0bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5638f78ab9440479a209d0023e6d0bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5638f78ab9440479a209d0023e6d0bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b5638f78ab9440479a209d0023e6d0bd"}]}] Aug 19 16:36:34.117571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1328462527 Aug 19 16:36:34.117571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: b5638f78ab9440479a209d0023e6d0bd Aug 19 16:36:34.117571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1328462527 Aug 19 16:36:34.117571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-ServerRescueNegativeTestJSON-1328462527-project Aug 19 16:36:34.117571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:36:34.117571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:36:34.117571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: 7936bf23a031418b8ce304aa3bbcf8a2 Aug 19 16:36:34.117571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1328462527-project Aug 19 16:36:34.117571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:36:34.117571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Cannot 'detach_volume' instance 9ed4c246-7322-49b8-9bf7-2efaacc54b0b while it is in vm_state rescued Aug 19 16:36:34.119006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'server_id': '9ed4c246-7322-49b8-9bf7-2efaacc54b0b', 'id': 'dc04bb90-55ba-4333-bf62-023881ec57ee'} Aug 19 16:36:34.119006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:36:34.119006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:36:34.119006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 19 16:36:34.119006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 19 16:36:34.119006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 19 16:36:34.119006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 19 16:36:34.119006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 19 16:36:34.119006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 19 16:36:34.119006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9ed4c246-7322-49b8-9bf7-2efaacc54b0b in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 19 16:36:34.119006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:36:34.119006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:36:34.119006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:36:34.119006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:36:34.119006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:36:34.119006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:36:34.119006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:36:34.119006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:36:34.119006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:36:34.119006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:36:34.120561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 19 16:36:34.120561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 19 16:36:34.120561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 19 16:36:34.120561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 19 16:36:34.120561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9ed4c246-7322-49b8-9bf7-2efaacc54b0b while it is in vm_state rescued Aug 19 16:36:34.120561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:36:34.120561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:36:34.120561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:36:34.120561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:36:34.120561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:36:34.120561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:36:34.120561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:36:34.120561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:36:34.120561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9ed4c246-7322-49b8-9bf7-2efaacc54b0b while it is in vm_state rescued Aug 19 16:36:34.120561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:36:34.120561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d2951f15-7b4f-45cd-bc48-adc21c376b42 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Returning 409 to user: Cannot 'detach_volume' instance 9ed4c246-7322-49b8-9bf7-2efaacc54b0b while it is in vm_state rescued {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:36:34.122097 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d2951f15-7b4f-45cd-bc48-adc21c376b42 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/os-volume_attachments/dc04bb90-55ba-4333-bf62-023881ec57ee" status: 409 len: 152 microversion: 2.1 time: 0.106646 Aug 19 16:36:34.122097 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 374/749] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Aug 19 16:36:34 2022] DELETE /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/os-volume_attachments/dc04bb90-55ba-4333-bf62-023881ec57ee => generated 152 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 19 16:36:34.127338 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-836280f7-8b2b-49b2-843d-0b422db9e533 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:36:34.127879 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-836280f7-8b2b-49b2-843d-0b422db9e533 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:34.134745 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-836280f7-8b2b-49b2-843d-0b422db9e533 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:34.135232 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-836280f7-8b2b-49b2-843d-0b422db9e533 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:34.135675 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-836280f7-8b2b-49b2-843d-0b422db9e533 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:34.136375 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-836280f7-8b2b-49b2-843d-0b422db9e533 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:34.136984 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-836280f7-8b2b-49b2-843d-0b422db9e533 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:34.137416 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-836280f7-8b2b-49b2-843d-0b422db9e533 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:34.204179 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-836280f7-8b2b-49b2-843d-0b422db9e533 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "POST /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/action" status: 202 len: 0 microversion: 2.1 time: 0.080492 Aug 19 16:36:34.205203 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 376/750] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Aug 19 16:36:34 2022] POST /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:36:34.208543 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f23239b1-033f-4dbc-8691-2cfe3aa40d28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1334300305", "imageRef": "da4af7b7-e205-4511-ad99-3478c2523f74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f05c65e5-ca4c-4b49-b86f-b320d0d9f99a"}], "security_groups": [{"name": "tempest-securitygroup--1913749661"}], "key_name": "tempest-keypair-696143613", "user_data": "}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:36:34.214054 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-4e4874e8-3834-4919-a29b-64509a1c9122 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:34.214753 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-4e4874e8-3834-4919-a29b-64509a1c9122 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:34.222254 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4e4874e8-3834-4919-a29b-64509a1c9122 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:34.222773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4e4874e8-3834-4919-a29b-64509a1c9122 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:34.223308 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4e4874e8-3834-4919-a29b-64509a1c9122 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:34.224007 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4e4874e8-3834-4919-a29b-64509a1c9122 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:34.224457 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4e4874e8-3834-4919-a29b-64509a1c9122 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:34.224965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4e4874e8-3834-4919-a29b-64509a1c9122 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:34.353811 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.network.neutron [None req-f23239b1-033f-4dbc-8691-2cfe3aa40d28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] validate_networks() for [('f05c65e5-ca4c-4b49-b86f-b320d0d9f99a', None, None, None, None, None)] {{(pid=127285) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:36:34.369237 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-4e4874e8-3834-4919-a29b-64509a1c9122 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:34.377796 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-4e4874e8-3834-4919-a29b-64509a1c9122 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1722 microversion: 2.1 time: 0.167789 Aug 19 16:36:34.379070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 377/751] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:34 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:34.702478 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-fb38e3fb-47a0-4e58-a735-b23be00158ca tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:34.703108 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-fb38e3fb-47a0-4e58-a735-b23be00158ca tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] [instance: c18cbc3d-cc71-4f92-b80f-8d75547d8e34] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:34.709823 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fb38e3fb-47a0-4e58-a735-b23be00158ca tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:34.710297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fb38e3fb-47a0-4e58-a735-b23be00158ca tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:34.710726 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fb38e3fb-47a0-4e58-a735-b23be00158ca tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:34.711405 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fb38e3fb-47a0-4e58-a735-b23be00158ca tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:34.711852 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fb38e3fb-47a0-4e58-a735-b23be00158ca tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:34.712272 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fb38e3fb-47a0-4e58-a735-b23be00158ca tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:34.726148 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-fb38e3fb-47a0-4e58-a735-b23be00158ca tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] HTTP exception thrown: Instance c18cbc3d-cc71-4f92-b80f-8d75547d8e34 could not be found. Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-fb38e3fb-47a0-4e58-a735-b23be00158ca tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Request method failure captured: Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 HTTP/1.1 Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7tcgDhydjzidOk7JI8tHrZyBWnFIV30qL53peDuFgzOVZ1ksAnkCW8WGNalZB94fAj93b2aIfqfYYE0IH6vRDjZl1s2iEzs1wgMEYY5XyoRjoDG08YsLBtRP8j6UDUltk7gbxHKDBD0uhJdpHRBDKm5GCKP-lSMhBr4WQrRPf8Po50 Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: b34c07333ddf4a19b35424d47d19dc60 Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1052536023 Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:36:34.727787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:36:34.729352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b34c07333ddf4a19b35424d47d19dc60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b34c07333ddf4a19b35424d47d19dc60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b34c07333ddf4a19b35424d47d19dc60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b34c07333ddf4a19b35424d47d19dc60"}]}] Aug 19 16:36:34.729352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-VolumesSnapshotTestJSON-1052536023 Aug 19 16:36:34.729352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: b34c07333ddf4a19b35424d47d19dc60 Aug 19 16:36:34.729352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1052536023 Aug 19 16:36:34.729352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-VolumesSnapshotTestJSON-1052536023-project Aug 19 16:36:34.729352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:36:34.729352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:36:34.729352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: d9e505bb350e4134976000a83bdd4fe1 Aug 19 16:36:34.729352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-VolumesSnapshotTestJSON-1052536023-project Aug 19 16:36:34.729352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:36:34.729352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance c18cbc3d-cc71-4f92-b80f-8d75547d8e34 could not be found. Aug 19 16:36:34.729352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': 'c18cbc3d-cc71-4f92-b80f-8d75547d8e34'} Aug 19 16:36:34.733331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:36:34.733331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:36:34.733331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:36:34.733331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:36:34.733331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:36:34.733331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:36:34.733331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:36:34.733331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:36:34.733331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:36:34.733331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:36:34.733331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c18cbc3d-cc71-4f92-b80f-8d75547d8e34 could not be found. Aug 19 16:36:34.733331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:36:34.733331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:36:34.733331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:36:34.733331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:36:34.733331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:36:34.733331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:36:34.733331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:36:34.733331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:36:34.733331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:36:34.734474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:36:34.734474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:36:34.734474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:36:34.734474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:36:34.734474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:36:34.734474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:36:34.734474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:36:34.734474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c18cbc3d-cc71-4f92-b80f-8d75547d8e34 could not be found. Aug 19 16:36:34.734474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:36:34.734474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:36:34.734474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:36:34.734474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:36:34.734474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:36:34.734474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:36:34.734474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:36:34.734474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:36:34.734474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c18cbc3d-cc71-4f92-b80f-8d75547d8e34 could not be found. Aug 19 16:36:34.734474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:36:34.735518 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-fb38e3fb-47a0-4e58-a735-b23be00158ca tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] Returning 404 to user: Instance c18cbc3d-cc71-4f92-b80f-8d75547d8e34 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:36:34.735518 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-fb38e3fb-47a0-4e58-a735-b23be00158ca tempest-VolumesSnapshotTestJSON-1052536023 tempest-VolumesSnapshotTestJSON-1052536023-project] 10.222.0.55 "GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34" status: 404 len: 111 microversion: 2.1 time: 0.030822 Aug 19 16:36:34.735518 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 378/752] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:34 2022] GET /compute/v2.1/servers/c18cbc3d-cc71-4f92-b80f-8d75547d8e34 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 16:36:35.192219 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-f23239b1-033f-4dbc-8691-2cfe3aa40d28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Flavor limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:36:35.192684 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-f23239b1-033f-4dbc-8691-2cfe3aa40d28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Image limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:36:35.193280 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-f23239b1-033f-4dbc-8691-2cfe3aa40d28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Flavor pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:36:35.193853 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-f23239b1-033f-4dbc-8691-2cfe3aa40d28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Image pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:36:35.194310 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-f23239b1-033f-4dbc-8691-2cfe3aa40d28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:36:35.203138 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f23239b1-033f-4dbc-8691-2cfe3aa40d28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:35.203620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f23239b1-033f-4dbc-8691-2cfe3aa40d28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:35.204047 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f23239b1-033f-4dbc-8691-2cfe3aa40d28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:35.204776 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f23239b1-033f-4dbc-8691-2cfe3aa40d28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:35.205233 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f23239b1-033f-4dbc-8691-2cfe3aa40d28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:35.205652 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f23239b1-033f-4dbc-8691-2cfe3aa40d28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:35.224009 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-f23239b1-033f-4dbc-8691-2cfe3aa40d28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Getting quotas for project 1743538991c8415394ac6cd5aed28d6a. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:36:35.228217 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-f23239b1-033f-4dbc-8691-2cfe3aa40d28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Getting quotas for user 9b0455ae3ec94c929c940df6a0f6687d and project 1743538991c8415394ac6cd5aed28d6a. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:36:35.240206 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f23239b1-033f-4dbc-8691-2cfe3aa40d28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Going to run 1 instances... {{(pid=127285) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:36:35.242597 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f23239b1-033f-4dbc-8691-2cfe3aa40d28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='da4af7b7-e205-4511-ad99-3478c2523f74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127285) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:36:35.289970 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f23239b1-033f-4dbc-8691-2cfe3aa40d28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.086022 Aug 19 16:36:35.291103 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 375/753] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Aug 19 16:36:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 16:36:35.302790 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2f7193bb-a387-4e43-975d-d25eb1517bad tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:35.303530 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2f7193bb-a387-4e43-975d-d25eb1517bad tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:35.371236 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2f7193bb-a387-4e43-975d-d25eb1517bad tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:35.378288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2f7193bb-a387-4e43-975d-d25eb1517bad tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1241 microversion: 2.1 time: 0.080099 Aug 19 16:36:35.384607 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 379/754] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:35 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:35.400530 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-04024068-5384-4a6e-a088-2261fef28ea2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:35.401169 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-04024068-5384-4a6e-a088-2261fef28ea2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:35.403099 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:35.408643 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-04024068-5384-4a6e-a088-2261fef28ea2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:35.409819 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-04024068-5384-4a6e-a088-2261fef28ea2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:35.410366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-04024068-5384-4a6e-a088-2261fef28ea2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:35.411234 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-04024068-5384-4a6e-a088-2261fef28ea2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:35.411789 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-04024068-5384-4a6e-a088-2261fef28ea2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:35.412106 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-04024068-5384-4a6e-a088-2261fef28ea2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:35.548432 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-04024068-5384-4a6e-a088-2261fef28ea2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:35.557222 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-04024068-5384-4a6e-a088-2261fef28ea2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1722 microversion: 2.1 time: 0.161224 Aug 19 16:36:35.557790 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 376/755] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:35 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:36.398047 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ca866a1a-5ee0-43df-ae98-c95873051f89 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:36.398564 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ca866a1a-5ee0-43df-ae98-c95873051f89 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:36.405734 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ca866a1a-5ee0-43df-ae98-c95873051f89 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:36.406211 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ca866a1a-5ee0-43df-ae98-c95873051f89 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:36.406646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ca866a1a-5ee0-43df-ae98-c95873051f89 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:36.407321 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ca866a1a-5ee0-43df-ae98-c95873051f89 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:36.407772 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ca866a1a-5ee0-43df-ae98-c95873051f89 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:36.408196 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ca866a1a-5ee0-43df-ae98-c95873051f89 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:36.467005 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ca866a1a-5ee0-43df-ae98-c95873051f89 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:36.475169 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ca866a1a-5ee0-43df-ae98-c95873051f89 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1245 microversion: 2.1 time: 0.081070 Aug 19 16:36:36.475725 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 380/756] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:36 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:36.580456 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-fbf46eae-fcf8-47f3-945e-9a69ffca11fe tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:36.581094 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-fbf46eae-fcf8-47f3-945e-9a69ffca11fe tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:36.587524 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fbf46eae-fcf8-47f3-945e-9a69ffca11fe tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:36.588006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fbf46eae-fcf8-47f3-945e-9a69ffca11fe tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:36.588440 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fbf46eae-fcf8-47f3-945e-9a69ffca11fe tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:36.589156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fbf46eae-fcf8-47f3-945e-9a69ffca11fe tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:36.589613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fbf46eae-fcf8-47f3-945e-9a69ffca11fe tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:36.590040 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fbf46eae-fcf8-47f3-945e-9a69ffca11fe tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:36.720064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fbf46eae-fcf8-47f3-945e-9a69ffca11fe tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:36.728979 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-fbf46eae-fcf8-47f3-945e-9a69ffca11fe tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1722 microversion: 2.1 time: 0.152405 Aug 19 16:36:36.729538 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 377/757] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:36 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:37.496191 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-92842cfe-57a3-4a95-80bd-dd820ab6ec94 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:37.496812 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-92842cfe-57a3-4a95-80bd-dd820ab6ec94 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:37.503705 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-92842cfe-57a3-4a95-80bd-dd820ab6ec94 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:37.504208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-92842cfe-57a3-4a95-80bd-dd820ab6ec94 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:37.504635 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-92842cfe-57a3-4a95-80bd-dd820ab6ec94 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:37.505339 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-92842cfe-57a3-4a95-80bd-dd820ab6ec94 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:37.505783 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-92842cfe-57a3-4a95-80bd-dd820ab6ec94 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:37.506204 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-92842cfe-57a3-4a95-80bd-dd820ab6ec94 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:37.564774 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-92842cfe-57a3-4a95-80bd-dd820ab6ec94 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:37.569015 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:37.574007 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-92842cfe-57a3-4a95-80bd-dd820ab6ec94 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1245 microversion: 2.1 time: 0.081625 Aug 19 16:36:37.574796 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 381/758] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:37 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:37.750718 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-5dbe8db5-99f0-4386-a0fa-696f65e6f810 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:37.751322 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-5dbe8db5-99f0-4386-a0fa-696f65e6f810 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:37.758456 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5dbe8db5-99f0-4386-a0fa-696f65e6f810 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:37.758930 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5dbe8db5-99f0-4386-a0fa-696f65e6f810 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:37.759360 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5dbe8db5-99f0-4386-a0fa-696f65e6f810 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:37.760032 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5dbe8db5-99f0-4386-a0fa-696f65e6f810 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:37.760477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5dbe8db5-99f0-4386-a0fa-696f65e6f810 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:37.760933 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5dbe8db5-99f0-4386-a0fa-696f65e6f810 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:37.886930 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5dbe8db5-99f0-4386-a0fa-696f65e6f810 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:37.895126 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-5dbe8db5-99f0-4386-a0fa-696f65e6f810 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1722 microversion: 2.1 time: 0.148313 Aug 19 16:36:37.895683 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 378/759] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:37 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:38.596022 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d9696593-ef87-4d4e-b913-1092a2e61c6f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:38.596635 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d9696593-ef87-4d4e-b913-1092a2e61c6f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:38.604026 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d9696593-ef87-4d4e-b913-1092a2e61c6f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:38.604504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d9696593-ef87-4d4e-b913-1092a2e61c6f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:38.604972 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d9696593-ef87-4d4e-b913-1092a2e61c6f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:38.605659 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d9696593-ef87-4d4e-b913-1092a2e61c6f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:38.606108 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d9696593-ef87-4d4e-b913-1092a2e61c6f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:38.606530 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d9696593-ef87-4d4e-b913-1092a2e61c6f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:38.670613 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d9696593-ef87-4d4e-b913-1092a2e61c6f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:38.678816 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d9696593-ef87-4d4e-b913-1092a2e61c6f tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1245 microversion: 2.1 time: 0.087332 Aug 19 16:36:38.679379 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 382/760] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:38 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:38.916234 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d2f4f394-1820-4b04-8ba4-3dabd4abcf2c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:38.916772 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d2f4f394-1820-4b04-8ba4-3dabd4abcf2c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:38.923150 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2f4f394-1820-4b04-8ba4-3dabd4abcf2c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:38.923627 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2f4f394-1820-4b04-8ba4-3dabd4abcf2c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:38.924061 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2f4f394-1820-4b04-8ba4-3dabd4abcf2c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:38.925446 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2f4f394-1820-4b04-8ba4-3dabd4abcf2c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:38.925899 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2f4f394-1820-4b04-8ba4-3dabd4abcf2c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:38.926323 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2f4f394-1820-4b04-8ba4-3dabd4abcf2c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:39.053023 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d2f4f394-1820-4b04-8ba4-3dabd4abcf2c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:39.061166 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d2f4f394-1820-4b04-8ba4-3dabd4abcf2c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1722 microversion: 2.1 time: 0.148833 Aug 19 16:36:39.061724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 379/761] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:38 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:39.701336 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-efcf75ff-06b3-4d25-9cf5-e5c43e77181d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:39.702058 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-efcf75ff-06b3-4d25-9cf5-e5c43e77181d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:39.709568 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-efcf75ff-06b3-4d25-9cf5-e5c43e77181d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:39.710047 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-efcf75ff-06b3-4d25-9cf5-e5c43e77181d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:39.710473 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-efcf75ff-06b3-4d25-9cf5-e5c43e77181d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:39.711162 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-efcf75ff-06b3-4d25-9cf5-e5c43e77181d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:39.711611 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-efcf75ff-06b3-4d25-9cf5-e5c43e77181d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:39.712030 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-efcf75ff-06b3-4d25-9cf5-e5c43e77181d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:39.773112 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-efcf75ff-06b3-4d25-9cf5-e5c43e77181d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:39.782525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-efcf75ff-06b3-4d25-9cf5-e5c43e77181d tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1237 microversion: 2.1 time: 0.086351 Aug 19 16:36:39.783126 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 383/762] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:39 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:40.082727 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-76e6a1a6-0f66-443e-af5c-2c21c38ec200 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:40.083335 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-76e6a1a6-0f66-443e-af5c-2c21c38ec200 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:40.089770 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76e6a1a6-0f66-443e-af5c-2c21c38ec200 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:40.090250 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76e6a1a6-0f66-443e-af5c-2c21c38ec200 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:40.090680 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76e6a1a6-0f66-443e-af5c-2c21c38ec200 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:40.091363 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76e6a1a6-0f66-443e-af5c-2c21c38ec200 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:40.091815 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76e6a1a6-0f66-443e-af5c-2c21c38ec200 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:40.092236 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-76e6a1a6-0f66-443e-af5c-2c21c38ec200 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:40.225544 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-76e6a1a6-0f66-443e-af5c-2c21c38ec200 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:40.233580 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-76e6a1a6-0f66-443e-af5c-2c21c38ec200 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1722 microversion: 2.1 time: 0.154808 Aug 19 16:36:40.234131 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 380/763] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:40 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:40.803960 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7bf49246-38d6-41ed-ae9f-4cda9ac2ebda tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:40.804792 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7bf49246-38d6-41ed-ae9f-4cda9ac2ebda tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:40.811588 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7bf49246-38d6-41ed-ae9f-4cda9ac2ebda tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:40.812073 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7bf49246-38d6-41ed-ae9f-4cda9ac2ebda tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:40.812646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7bf49246-38d6-41ed-ae9f-4cda9ac2ebda tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:40.813366 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7bf49246-38d6-41ed-ae9f-4cda9ac2ebda tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:40.813822 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7bf49246-38d6-41ed-ae9f-4cda9ac2ebda tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:40.814248 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7bf49246-38d6-41ed-ae9f-4cda9ac2ebda tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:40.883113 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7bf49246-38d6-41ed-ae9f-4cda9ac2ebda tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:40.891541 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7bf49246-38d6-41ed-ae9f-4cda9ac2ebda tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1293 microversion: 2.1 time: 0.091712 Aug 19 16:36:40.892023 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 384/764] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:40 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:41.256362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-fa93a23b-a408-44d8-9dcf-dd271b013393 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:41.257661 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-fa93a23b-a408-44d8-9dcf-dd271b013393 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:41.265722 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fa93a23b-a408-44d8-9dcf-dd271b013393 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:41.266610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fa93a23b-a408-44d8-9dcf-dd271b013393 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:41.267400 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fa93a23b-a408-44d8-9dcf-dd271b013393 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:41.269244 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fa93a23b-a408-44d8-9dcf-dd271b013393 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:41.269906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fa93a23b-a408-44d8-9dcf-dd271b013393 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:41.270613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fa93a23b-a408-44d8-9dcf-dd271b013393 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:41.463997 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fa93a23b-a408-44d8-9dcf-dd271b013393 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:41.472796 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-fa93a23b-a408-44d8-9dcf-dd271b013393 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1728 microversion: 2.1 time: 0.221177 Aug 19 16:36:41.473450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 381/765] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:41 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1728 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:36:41.493903 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-12820b2e-5726-4096-9fe5-00abef0904d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:41.494391 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-12820b2e-5726-4096-9fe5-00abef0904d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:41.500184 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-12820b2e-5726-4096-9fe5-00abef0904d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:41.500660 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-12820b2e-5726-4096-9fe5-00abef0904d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:41.501123 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-12820b2e-5726-4096-9fe5-00abef0904d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:41.501800 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-12820b2e-5726-4096-9fe5-00abef0904d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:41.502245 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-12820b2e-5726-4096-9fe5-00abef0904d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:41.502734 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-12820b2e-5726-4096-9fe5-00abef0904d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:41.578840 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-12820b2e-5726-4096-9fe5-00abef0904d1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088896 Aug 19 16:36:41.579427 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 385/766] 10.222.0.55 () {58 vars in 1275 bytes} [Fri Aug 19 16:36:41 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:36:41.912821 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-80d55a15-2fbb-447a-a349-248ab2e1da37 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:41.913447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-80d55a15-2fbb-447a-a349-248ab2e1da37 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:41.919776 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-80d55a15-2fbb-447a-a349-248ab2e1da37 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:41.920263 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-80d55a15-2fbb-447a-a349-248ab2e1da37 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:41.920701 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-80d55a15-2fbb-447a-a349-248ab2e1da37 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:41.921669 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-80d55a15-2fbb-447a-a349-248ab2e1da37 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:41.922137 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-80d55a15-2fbb-447a-a349-248ab2e1da37 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:41.922566 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-80d55a15-2fbb-447a-a349-248ab2e1da37 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:42.009643 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-80d55a15-2fbb-447a-a349-248ab2e1da37 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:42.018077 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-80d55a15-2fbb-447a-a349-248ab2e1da37 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1299 microversion: 2.1 time: 0.109597 Aug 19 16:36:42.029297 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 382/767] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:41 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:42.537142 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-6f2e7761-2266-4e38-bd4f-6c52cdb49082 req-22895d7b-46ab-4498-9ed5-2856b409ea30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ed4c246-7322-49b8-9bf7-2efaacc54b0b", "tag": "fe37ffff-6942-4410-8583-71fc27f97e1b"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:36:42.549246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-6f2e7761-2266-4e38-bd4f-6c52cdb49082 req-22895d7b-46ab-4498-9ed5-2856b409ea30 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:42.549996 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-6f2e7761-2266-4e38-bd4f-6c52cdb49082 req-22895d7b-46ab-4498-9ed5-2856b409ea30 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:42.550424 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-6f2e7761-2266-4e38-bd4f-6c52cdb49082 req-22895d7b-46ab-4498-9ed5-2856b409ea30 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:42.564864 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-6f2e7761-2266-4e38-bd4f-6c52cdb49082 req-22895d7b-46ab-4498-9ed5-2856b409ea30 service nova] Creating event network-changed:fe37ffff-6942-4410-8583-71fc27f97e1b for instance 9ed4c246-7322-49b8-9bf7-2efaacc54b0b on hv-cinder-83124 Aug 19 16:36:42.571173 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-6f2e7761-2266-4e38-bd4f-6c52cdb49082 req-22895d7b-46ab-4498-9ed5-2856b409ea30 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038481 Aug 19 16:36:42.572323 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 386/768] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:42.807582 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-eca1d797-94a5-4402-ab7b-ca427b7fb879 req-52597c3c-3482-465d-81a2-f22e2009aa14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e", "tag": "30a130c9-8de6-4d0c-bdd1-a2642504988a"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:36:42.819115 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-eca1d797-94a5-4402-ab7b-ca427b7fb879 req-52597c3c-3482-465d-81a2-f22e2009aa14 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:42.819997 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-eca1d797-94a5-4402-ab7b-ca427b7fb879 req-52597c3c-3482-465d-81a2-f22e2009aa14 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:42.820641 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-eca1d797-94a5-4402-ab7b-ca427b7fb879 req-52597c3c-3482-465d-81a2-f22e2009aa14 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:42.834427 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-eca1d797-94a5-4402-ab7b-ca427b7fb879 req-52597c3c-3482-465d-81a2-f22e2009aa14 service nova] Creating event network-changed:30a130c9-8de6-4d0c-bdd1-a2642504988a for instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e on hv-cinder-83124 Aug 19 16:36:42.839883 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-eca1d797-94a5-4402-ab7b-ca427b7fb879 req-52597c3c-3482-465d-81a2-f22e2009aa14 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036056 Aug 19 16:36:42.841374 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 383/769] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:43.041899 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f9c34d29-9919-4a4e-9096-9109f0ca531e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:43.042954 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f9c34d29-9919-4a4e-9096-9109f0ca531e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:43.051207 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f9c34d29-9919-4a4e-9096-9109f0ca531e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:43.051710 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f9c34d29-9919-4a4e-9096-9109f0ca531e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:43.052315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f9c34d29-9919-4a4e-9096-9109f0ca531e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:43.053216 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f9c34d29-9919-4a4e-9096-9109f0ca531e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:43.053805 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f9c34d29-9919-4a4e-9096-9109f0ca531e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:43.054241 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f9c34d29-9919-4a4e-9096-9109f0ca531e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:43.277858 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f9c34d29-9919-4a4e-9096-9109f0ca531e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:43.286920 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f9c34d29-9919-4a4e-9096-9109f0ca531e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1367 microversion: 2.1 time: 0.249908 Aug 19 16:36:43.288539 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 387/770] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:43 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:44.309009 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-feca14df-0567-4a64-818e-36b12d07e8c8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:44.309633 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-feca14df-0567-4a64-818e-36b12d07e8c8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:44.316124 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-feca14df-0567-4a64-818e-36b12d07e8c8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:44.316598 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-feca14df-0567-4a64-818e-36b12d07e8c8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:44.317059 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-feca14df-0567-4a64-818e-36b12d07e8c8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:44.317736 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-feca14df-0567-4a64-818e-36b12d07e8c8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:44.318182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-feca14df-0567-4a64-818e-36b12d07e8c8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:44.318600 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-feca14df-0567-4a64-818e-36b12d07e8c8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:44.444290 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-feca14df-0567-4a64-818e-36b12d07e8c8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:44.452140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-feca14df-0567-4a64-818e-36b12d07e8c8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1367 microversion: 2.1 time: 0.147915 Aug 19 16:36:44.452698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 384/771] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:44 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:36:44.589350 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-81e4c762-61a1-4ea8-8de5-06cb432cc7a7 req-7f992d79-fc1b-48e7-b125-c7589d43069e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ed4c246-7322-49b8-9bf7-2efaacc54b0b", "tag": "fe37ffff-6942-4410-8583-71fc27f97e1b"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:36:44.600288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-81e4c762-61a1-4ea8-8de5-06cb432cc7a7 req-7f992d79-fc1b-48e7-b125-c7589d43069e service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:44.600787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-81e4c762-61a1-4ea8-8de5-06cb432cc7a7 req-7f992d79-fc1b-48e7-b125-c7589d43069e service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:44.601226 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-81e4c762-61a1-4ea8-8de5-06cb432cc7a7 req-7f992d79-fc1b-48e7-b125-c7589d43069e service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:44.611833 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-81e4c762-61a1-4ea8-8de5-06cb432cc7a7 req-7f992d79-fc1b-48e7-b125-c7589d43069e service nova] Creating event network-changed:fe37ffff-6942-4410-8583-71fc27f97e1b for instance 9ed4c246-7322-49b8-9bf7-2efaacc54b0b on hv-cinder-83124 Aug 19 16:36:44.616908 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-81e4c762-61a1-4ea8-8de5-06cb432cc7a7 req-7f992d79-fc1b-48e7-b125-c7589d43069e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031205 Aug 19 16:36:44.617471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 388/772] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:36:45.473575 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2fcc319a-740e-458a-95da-8dace3108ce7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:45.474189 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2fcc319a-740e-458a-95da-8dace3108ce7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:45.476138 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=2 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:45.476883 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=6 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:45.483783 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2fcc319a-740e-458a-95da-8dace3108ce7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:45.484264 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2fcc319a-740e-458a-95da-8dace3108ce7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:45.484818 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2fcc319a-740e-458a-95da-8dace3108ce7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:45.485540 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2fcc319a-740e-458a-95da-8dace3108ce7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:45.485994 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2fcc319a-740e-458a-95da-8dace3108ce7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:45.486415 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2fcc319a-740e-458a-95da-8dace3108ce7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:45.618931 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2fcc319a-740e-458a-95da-8dace3108ce7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:45.626720 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2fcc319a-740e-458a-95da-8dace3108ce7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1367 microversion: 2.1 time: 0.157063 Aug 19 16:36:45.627760 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 385/773] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:45 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:46.646313 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=6 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:46.650954 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-10e0771f-06ab-42d6-91ac-c0c918f9a1be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:46.651644 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-10e0771f-06ab-42d6-91ac-c0c918f9a1be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:46.657991 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-10e0771f-06ab-42d6-91ac-c0c918f9a1be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:46.658478 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-10e0771f-06ab-42d6-91ac-c0c918f9a1be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:46.659539 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-10e0771f-06ab-42d6-91ac-c0c918f9a1be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:46.660228 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-10e0771f-06ab-42d6-91ac-c0c918f9a1be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:46.660672 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-10e0771f-06ab-42d6-91ac-c0c918f9a1be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:46.661149 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-10e0771f-06ab-42d6-91ac-c0c918f9a1be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:46.790779 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-10e0771f-06ab-42d6-91ac-c0c918f9a1be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:46.798287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-10e0771f-06ab-42d6-91ac-c0c918f9a1be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1367 microversion: 2.1 time: 0.152922 Aug 19 16:36:46.798847 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 389/774] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:46 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:47.820705 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2a7e3d2b-2e5f-44f3-8730-1c482131212a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:47.821361 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2a7e3d2b-2e5f-44f3-8730-1c482131212a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:47.828695 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2a7e3d2b-2e5f-44f3-8730-1c482131212a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:47.829674 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2a7e3d2b-2e5f-44f3-8730-1c482131212a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:47.830948 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2a7e3d2b-2e5f-44f3-8730-1c482131212a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:47.831872 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2a7e3d2b-2e5f-44f3-8730-1c482131212a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:47.832582 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2a7e3d2b-2e5f-44f3-8730-1c482131212a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:47.833227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2a7e3d2b-2e5f-44f3-8730-1c482131212a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:48.150662 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2a7e3d2b-2e5f-44f3-8730-1c482131212a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:48.158609 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2a7e3d2b-2e5f-44f3-8730-1c482131212a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1367 microversion: 2.1 time: 0.342864 Aug 19 16:36:48.159175 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 386/775] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:47 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:48.714640 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d2b939fa-65a1-47c3-bbf2-b44f09f60f70 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:48.715203 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d2b939fa-65a1-47c3-bbf2-b44f09f60f70 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:48.721979 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d2b939fa-65a1-47c3-bbf2-b44f09f60f70 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:48.722447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d2b939fa-65a1-47c3-bbf2-b44f09f60f70 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:48.722879 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d2b939fa-65a1-47c3-bbf2-b44f09f60f70 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:48.723552 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d2b939fa-65a1-47c3-bbf2-b44f09f60f70 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:48.723996 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d2b939fa-65a1-47c3-bbf2-b44f09f60f70 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:48.724439 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d2b939fa-65a1-47c3-bbf2-b44f09f60f70 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:48.804650 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.objects.instance [None req-d2b939fa-65a1-47c3-bbf2-b44f09f60f70 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lazy-loading 'services' on Instance uuid a1eddf01-3fc7-4c5c-8560-96cddb34a199 {{(pid=127284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:36:48.875481 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d2b939fa-65a1-47c3-bbf2-b44f09f60f70 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199/os-volume_attachments/799f882d-cb43-4af0-a9f4-e15c154e30f9" status: 202 len: 0 microversion: 2.1 time: 0.164605 Aug 19 16:36:48.876163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 390/776] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Aug 19 16:36:48 2022] DELETE /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199/os-volume_attachments/799f882d-cb43-4af0-a9f4-e15c154e30f9 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:36:49.179263 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2fefc96f-3611-492d-a968-b9d3846d4e3b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:49.180804 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2fefc96f-3611-492d-a968-b9d3846d4e3b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:49.188029 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2fefc96f-3611-492d-a968-b9d3846d4e3b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:49.188660 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2fefc96f-3611-492d-a968-b9d3846d4e3b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:49.189354 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2fefc96f-3611-492d-a968-b9d3846d4e3b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:49.190742 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2fefc96f-3611-492d-a968-b9d3846d4e3b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:49.191210 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2fefc96f-3611-492d-a968-b9d3846d4e3b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:49.191647 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2fefc96f-3611-492d-a968-b9d3846d4e3b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:49.324659 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2fefc96f-3611-492d-a968-b9d3846d4e3b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:49.332687 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2fefc96f-3611-492d-a968-b9d3846d4e3b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1367 microversion: 2.1 time: 0.157223 Aug 19 16:36:49.333268 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 387/777] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:49 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:50.354909 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-68fe6105-68a6-46af-a210-a128857da1eb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:50.355801 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-68fe6105-68a6-46af-a210-a128857da1eb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:50.365539 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-68fe6105-68a6-46af-a210-a128857da1eb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:50.366084 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-68fe6105-68a6-46af-a210-a128857da1eb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:50.366525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-68fe6105-68a6-46af-a210-a128857da1eb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:50.367218 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-68fe6105-68a6-46af-a210-a128857da1eb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:50.368946 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-68fe6105-68a6-46af-a210-a128857da1eb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:50.369217 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-68fe6105-68a6-46af-a210-a128857da1eb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:50.555219 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-68fe6105-68a6-46af-a210-a128857da1eb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:50.563700 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-68fe6105-68a6-46af-a210-a128857da1eb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1367 microversion: 2.1 time: 0.214330 Aug 19 16:36:50.564267 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 391/778] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:50 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:51.057795 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ef29fbe0-10fb-465b-ac22-525f4fff5745 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:36:51.064204 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ef29fbe0-10fb-465b-ac22-525f4fff5745 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:51.065274 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ef29fbe0-10fb-465b-ac22-525f4fff5745 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:51.065717 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ef29fbe0-10fb-465b-ac22-525f4fff5745 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:51.089306 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ef29fbe0-10fb-465b-ac22-525f4fff5745 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Going to try to stop instance {{(pid=127285) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 19 16:36:51.130339 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ef29fbe0-10fb-465b-ac22-525f4fff5745 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "POST /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199/action" status: 202 len: 0 microversion: 2.1 time: 0.076119 Aug 19 16:36:51.130951 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 388/779] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Aug 19 16:36:51 2022] POST /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:36:51.139188 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-717924c1-62c3-475b-8d36-c3b5715902e2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:51.139797 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-717924c1-62c3-475b-8d36-c3b5715902e2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:51.146583 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-717924c1-62c3-475b-8d36-c3b5715902e2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:51.147205 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-717924c1-62c3-475b-8d36-c3b5715902e2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:51.147733 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-717924c1-62c3-475b-8d36-c3b5715902e2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:51.148516 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-717924c1-62c3-475b-8d36-c3b5715902e2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:51.149187 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-717924c1-62c3-475b-8d36-c3b5715902e2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:51.150244 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-717924c1-62c3-475b-8d36-c3b5715902e2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:51.279467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-717924c1-62c3-475b-8d36-c3b5715902e2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:51.287607 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-717924c1-62c3-475b-8d36-c3b5715902e2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1678 microversion: 2.1 time: 0.152180 Aug 19 16:36:51.288189 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 392/780] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:51 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:51.585825 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-23efca04-28dd-4430-9726-98b96ae9848e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:51.586545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-23efca04-28dd-4430-9726-98b96ae9848e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:51.592645 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-23efca04-28dd-4430-9726-98b96ae9848e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:51.593163 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-23efca04-28dd-4430-9726-98b96ae9848e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:51.593624 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-23efca04-28dd-4430-9726-98b96ae9848e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:51.594328 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-23efca04-28dd-4430-9726-98b96ae9848e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:51.594777 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-23efca04-28dd-4430-9726-98b96ae9848e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:51.595196 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-23efca04-28dd-4430-9726-98b96ae9848e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:51.722443 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-23efca04-28dd-4430-9726-98b96ae9848e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:51.726004 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:51.730902 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-23efca04-28dd-4430-9726-98b96ae9848e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1367 microversion: 2.1 time: 0.149281 Aug 19 16:36:51.731458 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 389/781] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:51 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:52.146467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-477f0711-107a-4269-975f-7d27a46aaa06 req-aa163908-235b-46d6-8554-a582934de8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e", "name": "network-vif-plugged", "status": "completed", "tag": "30a130c9-8de6-4d0c-bdd1-a2642504988a"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:36:52.159875 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-477f0711-107a-4269-975f-7d27a46aaa06 req-aa163908-235b-46d6-8554-a582934de8b6 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:52.160302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-477f0711-107a-4269-975f-7d27a46aaa06 req-aa163908-235b-46d6-8554-a582934de8b6 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:52.160744 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-477f0711-107a-4269-975f-7d27a46aaa06 req-aa163908-235b-46d6-8554-a582934de8b6 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:52.172071 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-477f0711-107a-4269-975f-7d27a46aaa06 req-aa163908-235b-46d6-8554-a582934de8b6 service nova] Creating event network-vif-plugged:30a130c9-8de6-4d0c-bdd1-a2642504988a for instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e on hv-cinder-83124 Aug 19 16:36:52.177014 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-477f0711-107a-4269-975f-7d27a46aaa06 req-aa163908-235b-46d6-8554-a582934de8b6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034957 Aug 19 16:36:52.177611 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 393/782] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:52.309344 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6c22d4ad-0dc7-4dec-bcb7-6481ccdbcd84 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:52.309959 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6c22d4ad-0dc7-4dec-bcb7-6481ccdbcd84 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:52.318114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6c22d4ad-0dc7-4dec-bcb7-6481ccdbcd84 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:52.318601 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6c22d4ad-0dc7-4dec-bcb7-6481ccdbcd84 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:52.319040 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6c22d4ad-0dc7-4dec-bcb7-6481ccdbcd84 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:52.319738 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6c22d4ad-0dc7-4dec-bcb7-6481ccdbcd84 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:52.320196 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6c22d4ad-0dc7-4dec-bcb7-6481ccdbcd84 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:52.320626 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6c22d4ad-0dc7-4dec-bcb7-6481ccdbcd84 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:52.501359 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6c22d4ad-0dc7-4dec-bcb7-6481ccdbcd84 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:52.509502 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6c22d4ad-0dc7-4dec-bcb7-6481ccdbcd84 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1678 microversion: 2.1 time: 0.204047 Aug 19 16:36:52.510073 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 390/783] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:52 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1678 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:52.752028 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-45699923-6a4e-4a20-ab17-0325deb29c0b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:52.752845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-45699923-6a4e-4a20-ab17-0325deb29c0b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:52.759801 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-45699923-6a4e-4a20-ab17-0325deb29c0b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:52.760270 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-45699923-6a4e-4a20-ab17-0325deb29c0b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:52.760699 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-45699923-6a4e-4a20-ab17-0325deb29c0b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:52.761412 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-45699923-6a4e-4a20-ab17-0325deb29c0b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:52.761858 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-45699923-6a4e-4a20-ab17-0325deb29c0b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:52.762277 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-45699923-6a4e-4a20-ab17-0325deb29c0b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:52.897844 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-45699923-6a4e-4a20-ab17-0325deb29c0b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:52.905437 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-45699923-6a4e-4a20-ab17-0325deb29c0b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1367 microversion: 2.1 time: 0.157652 Aug 19 16:36:52.905989 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 394/784] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:52 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:53.531286 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2989606d-8ad5-45bb-8397-878ffb881dc4 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:53.531941 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2989606d-8ad5-45bb-8397-878ffb881dc4 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:53.538464 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2989606d-8ad5-45bb-8397-878ffb881dc4 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:53.538940 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2989606d-8ad5-45bb-8397-878ffb881dc4 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:53.539371 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2989606d-8ad5-45bb-8397-878ffb881dc4 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:53.540051 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2989606d-8ad5-45bb-8397-878ffb881dc4 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:53.540499 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2989606d-8ad5-45bb-8397-878ffb881dc4 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:53.540957 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2989606d-8ad5-45bb-8397-878ffb881dc4 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:53.670359 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2989606d-8ad5-45bb-8397-878ffb881dc4 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:53.679046 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2989606d-8ad5-45bb-8397-878ffb881dc4 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1678 microversion: 2.1 time: 0.151510 Aug 19 16:36:53.679718 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 391/785] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:53 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:53.926866 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-47a00fad-0759-4e0d-b536-af5573722941 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:53.927414 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-47a00fad-0759-4e0d-b536-af5573722941 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:53.933749 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-47a00fad-0759-4e0d-b536-af5573722941 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:53.934225 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-47a00fad-0759-4e0d-b536-af5573722941 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:53.934655 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-47a00fad-0759-4e0d-b536-af5573722941 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:53.935331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-47a00fad-0759-4e0d-b536-af5573722941 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:53.935778 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-47a00fad-0759-4e0d-b536-af5573722941 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:53.936193 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-47a00fad-0759-4e0d-b536-af5573722941 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:54.069269 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-47a00fad-0759-4e0d-b536-af5573722941 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:54.077024 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-47a00fad-0759-4e0d-b536-af5573722941 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1367 microversion: 2.1 time: 0.154789 Aug 19 16:36:54.077588 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 395/786] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:53 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:54.362185 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-bb24b452-71ba-40c2-9133-e6742377edea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:54.362717 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-bb24b452-71ba-40c2-9133-e6742377edea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:54.368686 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bb24b452-71ba-40c2-9133-e6742377edea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:54.369268 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bb24b452-71ba-40c2-9133-e6742377edea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:54.369625 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bb24b452-71ba-40c2-9133-e6742377edea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:54.370309 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bb24b452-71ba-40c2-9133-e6742377edea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:54.370762 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bb24b452-71ba-40c2-9133-e6742377edea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:54.371184 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bb24b452-71ba-40c2-9133-e6742377edea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:54.400018 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-bb24b452-71ba-40c2-9133-e6742377edea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8/os-volume_attachments/e623f028-5c06-4497-ae3e-f5cd6169d256" status: 200 len: 194 microversion: 2.20 time: 0.042381 Aug 19 16:36:54.400584 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 392/787] 10.222.0.55 () {60 vars in 1454 bytes} [Fri Aug 19 16:36:54 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8/os-volume_attachments/e623f028-5c06-4497-ae3e-f5cd6169d256 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:36:54.466920 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2a4d64c1-70a0-4084-8fe4-224fd34ec900 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:54.467415 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2a4d64c1-70a0-4084-8fe4-224fd34ec900 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:54.473766 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2a4d64c1-70a0-4084-8fe4-224fd34ec900 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:54.474250 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2a4d64c1-70a0-4084-8fe4-224fd34ec900 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:54.474688 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2a4d64c1-70a0-4084-8fe4-224fd34ec900 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:54.475379 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2a4d64c1-70a0-4084-8fe4-224fd34ec900 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:54.475833 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2a4d64c1-70a0-4084-8fe4-224fd34ec900 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:54.476261 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2a4d64c1-70a0-4084-8fe4-224fd34ec900 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:54.554991 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.objects.instance [None req-2a4d64c1-70a0-4084-8fe4-224fd34ec900 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lazy-loading 'services' on Instance uuid 894cc1e2-8a17-4de0-8127-b929095837d8 {{(pid=127284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:36:54.626681 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2a4d64c1-70a0-4084-8fe4-224fd34ec900 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "DELETE /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8/os-volume_attachments/e623f028-5c06-4497-ae3e-f5cd6169d256" status: 202 len: 0 microversion: 2.20 time: 0.163505 Aug 19 16:36:54.627348 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 396/788] 10.222.0.55 () {60 vars in 1457 bytes} [Fri Aug 19 16:36:54 2022] DELETE /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8/os-volume_attachments/e623f028-5c06-4497-ae3e-f5cd6169d256 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:36:54.635710 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6e4a8d19-6f6f-4801-b68b-24520d96effa tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:54.637890 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6e4a8d19-6f6f-4801-b68b-24520d96effa tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:54.644437 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e4a8d19-6f6f-4801-b68b-24520d96effa tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:54.644956 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e4a8d19-6f6f-4801-b68b-24520d96effa tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:54.645388 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e4a8d19-6f6f-4801-b68b-24520d96effa tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:54.646074 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e4a8d19-6f6f-4801-b68b-24520d96effa tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:54.646523 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e4a8d19-6f6f-4801-b68b-24520d96effa tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:54.646940 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6e4a8d19-6f6f-4801-b68b-24520d96effa tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:54.676624 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6e4a8d19-6f6f-4801-b68b-24520d96effa tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044884 Aug 19 16:36:54.677194 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 393/789] 10.222.0.55 () {60 vars in 1343 bytes} [Fri Aug 19 16:36:54 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:36:54.700618 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7b4bca2a-5ef9-4403-9221-89414dbb9da5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:54.701352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7b4bca2a-5ef9-4403-9221-89414dbb9da5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:54.707607 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7b4bca2a-5ef9-4403-9221-89414dbb9da5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:54.708099 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7b4bca2a-5ef9-4403-9221-89414dbb9da5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:54.708539 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7b4bca2a-5ef9-4403-9221-89414dbb9da5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:54.709258 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7b4bca2a-5ef9-4403-9221-89414dbb9da5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:54.709731 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7b4bca2a-5ef9-4403-9221-89414dbb9da5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:54.710140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7b4bca2a-5ef9-4403-9221-89414dbb9da5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:54.853334 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7b4bca2a-5ef9-4403-9221-89414dbb9da5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:54.862477 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7b4bca2a-5ef9-4403-9221-89414dbb9da5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1678 microversion: 2.1 time: 0.166212 Aug 19 16:36:54.863232 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 397/790] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:54 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:55.098898 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-acd68c89-8de5-481c-8a5a-1d4b6d88dba2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:55.099504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-acd68c89-8de5-481c-8a5a-1d4b6d88dba2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:55.105368 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-acd68c89-8de5-481c-8a5a-1d4b6d88dba2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:55.105849 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-acd68c89-8de5-481c-8a5a-1d4b6d88dba2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:55.106285 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-acd68c89-8de5-481c-8a5a-1d4b6d88dba2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:55.106966 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-acd68c89-8de5-481c-8a5a-1d4b6d88dba2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:55.107418 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-acd68c89-8de5-481c-8a5a-1d4b6d88dba2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:55.107847 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-acd68c89-8de5-481c-8a5a-1d4b6d88dba2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:55.237261 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-acd68c89-8de5-481c-8a5a-1d4b6d88dba2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:55.244841 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-acd68c89-8de5-481c-8a5a-1d4b6d88dba2 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1557 microversion: 2.1 time: 0.150494 Aug 19 16:36:55.245405 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 394/791] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:55 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:55.265226 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-644b7135-1dce-44d6-954a-0e0c061e5359 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:55.265754 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-644b7135-1dce-44d6-954a-0e0c061e5359 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:55.272951 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-644b7135-1dce-44d6-954a-0e0c061e5359 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:55.273435 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-644b7135-1dce-44d6-954a-0e0c061e5359 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:55.273872 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-644b7135-1dce-44d6-954a-0e0c061e5359 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:55.274562 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-644b7135-1dce-44d6-954a-0e0c061e5359 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:55.275016 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-644b7135-1dce-44d6-954a-0e0c061e5359 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:55.275444 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-644b7135-1dce-44d6-954a-0e0c061e5359 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:55.353962 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-644b7135-1dce-44d6-954a-0e0c061e5359 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092571 Aug 19 16:36:55.354605 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 398/792] 10.222.0.55 () {58 vars in 1275 bytes} [Fri Aug 19 16:36:55 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:55.689512 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-fa939ca4-9c23-46ff-bb6e-2f4b9eb01926 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:55.692526 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-fa939ca4-9c23-46ff-bb6e-2f4b9eb01926 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:55.699596 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fa939ca4-9c23-46ff-bb6e-2f4b9eb01926 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:55.700084 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fa939ca4-9c23-46ff-bb6e-2f4b9eb01926 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:55.700518 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fa939ca4-9c23-46ff-bb6e-2f4b9eb01926 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:55.701248 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fa939ca4-9c23-46ff-bb6e-2f4b9eb01926 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:55.701701 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fa939ca4-9c23-46ff-bb6e-2f4b9eb01926 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:55.702123 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fa939ca4-9c23-46ff-bb6e-2f4b9eb01926 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:55.733344 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-fa939ca4-9c23-46ff-bb6e-2f4b9eb01926 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047789 Aug 19 16:36:55.733920 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 395/793] 10.222.0.55 () {60 vars in 1343 bytes} [Fri Aug 19 16:36:55 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:36:55.885442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a34a7d99-6a19-4f69-aa8a-bec253799dec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:55.886822 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a34a7d99-6a19-4f69-aa8a-bec253799dec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:55.894223 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a34a7d99-6a19-4f69-aa8a-bec253799dec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:55.894743 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a34a7d99-6a19-4f69-aa8a-bec253799dec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:55.895311 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a34a7d99-6a19-4f69-aa8a-bec253799dec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:55.896074 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a34a7d99-6a19-4f69-aa8a-bec253799dec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:55.896691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a34a7d99-6a19-4f69-aa8a-bec253799dec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:55.897145 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a34a7d99-6a19-4f69-aa8a-bec253799dec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:56.134290 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a34a7d99-6a19-4f69-aa8a-bec253799dec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:56.136924 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:36:56.142381 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a34a7d99-6a19-4f69-aa8a-bec253799dec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1678 microversion: 2.1 time: 0.261575 Aug 19 16:36:56.152674 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 399/794] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:55 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1678 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:56.637793 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-1ec11948-5ad6-48c8-ad5a-40278f586a40 req-f86e0b9b-f7fd-4d67-a73a-5a2e86267ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e", "tag": "30a130c9-8de6-4d0c-bdd1-a2642504988a"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:36:56.647655 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-1ec11948-5ad6-48c8-ad5a-40278f586a40 req-f86e0b9b-f7fd-4d67-a73a-5a2e86267ac7 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:56.648134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-1ec11948-5ad6-48c8-ad5a-40278f586a40 req-f86e0b9b-f7fd-4d67-a73a-5a2e86267ac7 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:56.648561 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-1ec11948-5ad6-48c8-ad5a-40278f586a40 req-f86e0b9b-f7fd-4d67-a73a-5a2e86267ac7 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:56.660621 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-1ec11948-5ad6-48c8-ad5a-40278f586a40 req-f86e0b9b-f7fd-4d67-a73a-5a2e86267ac7 service nova] Creating event network-changed:30a130c9-8de6-4d0c-bdd1-a2642504988a for instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e on hv-cinder-83124 Aug 19 16:36:56.665620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-1ec11948-5ad6-48c8-ad5a-40278f586a40 req-f86e0b9b-f7fd-4d67-a73a-5a2e86267ac7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031480 Aug 19 16:36:56.666215 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 396/795] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:36:56.860593 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-6a022502-a33a-4931-9ed5-79ede183cdcb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:56.863298 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-6a022502-a33a-4931-9ed5-79ede183cdcb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:56.869711 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6a022502-a33a-4931-9ed5-79ede183cdcb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:56.870480 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6a022502-a33a-4931-9ed5-79ede183cdcb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:56.871111 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6a022502-a33a-4931-9ed5-79ede183cdcb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:56.872008 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6a022502-a33a-4931-9ed5-79ede183cdcb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:56.872642 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6a022502-a33a-4931-9ed5-79ede183cdcb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:56.873279 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6a022502-a33a-4931-9ed5-79ede183cdcb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:56.906965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-6a022502-a33a-4931-9ed5-79ede183cdcb tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.164677 Aug 19 16:36:56.907826 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 400/796] 10.222.0.55 () {60 vars in 1343 bytes} [Fri Aug 19 16:36:56 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8/os-volume_attachments => generated 25 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:56.973552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-9bbcb48e-21f4-4ce2-86a0-cdb1bfc61461 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:56.974144 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-9bbcb48e-21f4-4ce2-86a0-cdb1bfc61461 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:56.980898 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9bbcb48e-21f4-4ce2-86a0-cdb1bfc61461 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:56.981602 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9bbcb48e-21f4-4ce2-86a0-cdb1bfc61461 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:56.982047 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9bbcb48e-21f4-4ce2-86a0-cdb1bfc61461 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:56.982739 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9bbcb48e-21f4-4ce2-86a0-cdb1bfc61461 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:56.983194 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9bbcb48e-21f4-4ce2-86a0-cdb1bfc61461 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:56.983652 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9bbcb48e-21f4-4ce2-86a0-cdb1bfc61461 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:57.014131 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-9bbcb48e-21f4-4ce2-86a0-cdb1bfc61461 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Going to try to terminate instance {{(pid=127285) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:36:57.097181 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-9bbcb48e-21f4-4ce2-86a0-cdb1bfc61461 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "DELETE /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 204 len: 0 microversion: 2.20 time: 0.128378 Aug 19 16:36:57.098116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 397/797] 10.222.0.55 () {60 vars in 1280 bytes} [Fri Aug 19 16:36:56 2022] DELETE /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 19 16:36:57.110138 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-cf31de63-3ab6-4fb0-bb38-a0f47bdcc1d0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:57.110824 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-cf31de63-3ab6-4fb0-bb38-a0f47bdcc1d0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:57.122625 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cf31de63-3ab6-4fb0-bb38-a0f47bdcc1d0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:57.123112 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cf31de63-3ab6-4fb0-bb38-a0f47bdcc1d0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:57.123539 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cf31de63-3ab6-4fb0-bb38-a0f47bdcc1d0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:57.124574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cf31de63-3ab6-4fb0-bb38-a0f47bdcc1d0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:57.125845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cf31de63-3ab6-4fb0-bb38-a0f47bdcc1d0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:57.125966 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cf31de63-3ab6-4fb0-bb38-a0f47bdcc1d0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:57.164428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a01bb3aa-3a91-40af-9030-495725559458 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:57.167123 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a01bb3aa-3a91-40af-9030-495725559458 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:57.176411 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a01bb3aa-3a91-40af-9030-495725559458 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:57.177316 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a01bb3aa-3a91-40af-9030-495725559458 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:57.177983 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a01bb3aa-3a91-40af-9030-495725559458 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:57.178905 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a01bb3aa-3a91-40af-9030-495725559458 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:57.179570 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a01bb3aa-3a91-40af-9030-495725559458 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:57.180205 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a01bb3aa-3a91-40af-9030-495725559458 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:57.289382 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-cf31de63-3ab6-4fb0-bb38-a0f47bdcc1d0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:57.297888 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-cf31de63-3ab6-4fb0-bb38-a0f47bdcc1d0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:57.300054 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-cf31de63-3ab6-4fb0-bb38-a0f47bdcc1d0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:57.301297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-cf31de63-3ab6-4fb0-bb38-a0f47bdcc1d0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.198641 Aug 19 16:36:57.301863 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 401/798] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:36:57 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:36:57.611135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a01bb3aa-3a91-40af-9030-495725559458 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:57.620331 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a01bb3aa-3a91-40af-9030-495725559458 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1678 microversion: 2.1 time: 0.460359 Aug 19 16:36:57.620926 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 398/799] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:57 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1678 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:58.324014 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2847549e-fcb1-4b74-9117-2150a6a07c4f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:58.324833 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2847549e-fcb1-4b74-9117-2150a6a07c4f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:58.332260 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2847549e-fcb1-4b74-9117-2150a6a07c4f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:58.333052 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2847549e-fcb1-4b74-9117-2150a6a07c4f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:58.333665 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2847549e-fcb1-4b74-9117-2150a6a07c4f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:58.334542 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2847549e-fcb1-4b74-9117-2150a6a07c4f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:58.335001 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2847549e-fcb1-4b74-9117-2150a6a07c4f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:58.335425 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2847549e-fcb1-4b74-9117-2150a6a07c4f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:58.469216 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2847549e-fcb1-4b74-9117-2150a6a07c4f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:58.478327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2847549e-fcb1-4b74-9117-2150a6a07c4f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:58.479875 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2847549e-fcb1-4b74-9117-2150a6a07c4f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:58.481124 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2847549e-fcb1-4b74-9117-2150a6a07c4f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.161180 Aug 19 16:36:58.481686 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 402/800] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:36:58 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:36:58.641515 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2ac442ed-e446-40b1-871a-09fdb61b92fb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:58.642134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2ac442ed-e446-40b1-871a-09fdb61b92fb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:58.650013 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ac442ed-e446-40b1-871a-09fdb61b92fb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:58.650467 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ac442ed-e446-40b1-871a-09fdb61b92fb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:58.650904 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ac442ed-e446-40b1-871a-09fdb61b92fb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:58.651614 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ac442ed-e446-40b1-871a-09fdb61b92fb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:58.652115 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ac442ed-e446-40b1-871a-09fdb61b92fb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:58.652732 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ac442ed-e446-40b1-871a-09fdb61b92fb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:58.789296 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2ac442ed-e446-40b1-871a-09fdb61b92fb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:58.797251 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2ac442ed-e446-40b1-871a-09fdb61b92fb tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1678 microversion: 2.1 time: 0.159405 Aug 19 16:36:58.797818 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 399/801] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:58 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:36:59.507342 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7ca75f52-62f8-4be3-a9c7-c0f55eb49a7b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:59.508040 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7ca75f52-62f8-4be3-a9c7-c0f55eb49a7b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:59.514462 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7ca75f52-62f8-4be3-a9c7-c0f55eb49a7b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:59.514942 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7ca75f52-62f8-4be3-a9c7-c0f55eb49a7b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:59.515368 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7ca75f52-62f8-4be3-a9c7-c0f55eb49a7b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:59.516049 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7ca75f52-62f8-4be3-a9c7-c0f55eb49a7b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:59.516492 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7ca75f52-62f8-4be3-a9c7-c0f55eb49a7b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:59.516940 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7ca75f52-62f8-4be3-a9c7-c0f55eb49a7b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:59.655879 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7ca75f52-62f8-4be3-a9c7-c0f55eb49a7b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:59.664470 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7ca75f52-62f8-4be3-a9c7-c0f55eb49a7b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:59.666057 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7ca75f52-62f8-4be3-a9c7-c0f55eb49a7b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:36:59.667565 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7ca75f52-62f8-4be3-a9c7-c0f55eb49a7b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1724 microversion: 2.20 time: 0.165329 Aug 19 16:36:59.668129 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 403/802] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:36:59 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:36:59.819380 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a4dbc9d6-b832-401c-9661-55358a9a05f2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:36:59.819987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a4dbc9d6-b832-401c-9661-55358a9a05f2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:36:59.826721 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a4dbc9d6-b832-401c-9661-55358a9a05f2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:59.827200 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a4dbc9d6-b832-401c-9661-55358a9a05f2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:59.827628 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a4dbc9d6-b832-401c-9661-55358a9a05f2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:36:59.828316 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a4dbc9d6-b832-401c-9661-55358a9a05f2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:36:59.828782 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a4dbc9d6-b832-401c-9661-55358a9a05f2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:36:59.829205 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a4dbc9d6-b832-401c-9661-55358a9a05f2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:00.127107 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a4dbc9d6-b832-401c-9661-55358a9a05f2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:00.135853 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a4dbc9d6-b832-401c-9661-55358a9a05f2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1678 microversion: 2.1 time: 0.320821 Aug 19 16:37:00.137145 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 400/803] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:36:59 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1678 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:00.693970 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1bec8a42-9b40-4e68-baaf-0dc5cbd50f5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:00.694713 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1bec8a42-9b40-4e68-baaf-0dc5cbd50f5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:00.702028 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1bec8a42-9b40-4e68-baaf-0dc5cbd50f5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:00.702601 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1bec8a42-9b40-4e68-baaf-0dc5cbd50f5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:00.703016 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1bec8a42-9b40-4e68-baaf-0dc5cbd50f5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:00.703897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1bec8a42-9b40-4e68-baaf-0dc5cbd50f5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:00.704509 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1bec8a42-9b40-4e68-baaf-0dc5cbd50f5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:00.705375 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1bec8a42-9b40-4e68-baaf-0dc5cbd50f5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:00.797293 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-7832b6c8-b2f5-46b4-8b5a-5ce322405efa req-d7f16ed2-20da-48be-b14b-ebebcfd6a8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894cc1e2-8a17-4de0-8127-b929095837d8", "name": "network-vif-deleted", "tag": "72e0a5f4-4545-47a6-8d9a-ae53acb35877"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:37:00.815010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-7832b6c8-b2f5-46b4-8b5a-5ce322405efa req-d7f16ed2-20da-48be-b14b-ebebcfd6a8b0 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:00.815605 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-7832b6c8-b2f5-46b4-8b5a-5ce322405efa req-d7f16ed2-20da-48be-b14b-ebebcfd6a8b0 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:00.817162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-7832b6c8-b2f5-46b4-8b5a-5ce322405efa req-d7f16ed2-20da-48be-b14b-ebebcfd6a8b0 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:00.841880 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1bec8a42-9b40-4e68-baaf-0dc5cbd50f5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:00.852297 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-7832b6c8-b2f5-46b4-8b5a-5ce322405efa req-d7f16ed2-20da-48be-b14b-ebebcfd6a8b0 service nova] Creating event network-vif-deleted:72e0a5f4-4545-47a6-8d9a-ae53acb35877 for instance 894cc1e2-8a17-4de0-8127-b929095837d8 on hv-cinder-83124 Aug 19 16:37:00.866183 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-7832b6c8-b2f5-46b4-8b5a-5ce322405efa req-d7f16ed2-20da-48be-b14b-ebebcfd6a8b0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072699 Aug 19 16:37:00.866805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 401/804] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:37:00.877860 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1bec8a42-9b40-4e68-baaf-0dc5cbd50f5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:00.880063 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1bec8a42-9b40-4e68-baaf-0dc5cbd50f5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:00.882519 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1bec8a42-9b40-4e68-baaf-0dc5cbd50f5b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 200 len: 1656 microversion: 2.20 time: 0.195474 Aug 19 16:37:00.883595 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 404/805] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:37:00 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 1656 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:37:01.159047 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8c5e0a3d-1fb5-4e98-ae38-4461b6e7f7ec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:01.159753 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8c5e0a3d-1fb5-4e98-ae38-4461b6e7f7ec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:01.168117 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8c5e0a3d-1fb5-4e98-ae38-4461b6e7f7ec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:01.169160 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8c5e0a3d-1fb5-4e98-ae38-4461b6e7f7ec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:01.169819 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8c5e0a3d-1fb5-4e98-ae38-4461b6e7f7ec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:01.170760 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8c5e0a3d-1fb5-4e98-ae38-4461b6e7f7ec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:01.171436 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8c5e0a3d-1fb5-4e98-ae38-4461b6e7f7ec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:01.172086 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8c5e0a3d-1fb5-4e98-ae38-4461b6e7f7ec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:01.318940 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-8c5e0a3d-1fb5-4e98-ae38-4461b6e7f7ec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:01.327865 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8c5e0a3d-1fb5-4e98-ae38-4461b6e7f7ec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1678 microversion: 2.1 time: 0.173163 Aug 19 16:37:01.332079 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 402/806] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:01 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:01.907943 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1f70c647-150e-410f-816f-1e65e2209651 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:01.908906 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1f70c647-150e-410f-816f-1e65e2209651 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:01.916620 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:01.922775 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1f70c647-150e-410f-816f-1e65e2209651 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:01.923283 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1f70c647-150e-410f-816f-1e65e2209651 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:01.923715 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1f70c647-150e-410f-816f-1e65e2209651 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:01.925200 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1f70c647-150e-410f-816f-1e65e2209651 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:01.925568 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1f70c647-150e-410f-816f-1e65e2209651 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:01.925991 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1f70c647-150e-410f-816f-1e65e2209651 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:01.956960 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-1f70c647-150e-410f-816f-1e65e2209651 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] HTTP exception thrown: Instance 894cc1e2-8a17-4de0-8127-b929095837d8 could not be found. Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1f70c647-150e-410f-816f-1e65e2209651 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Request method failure captured: Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 HTTP/1.1 Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7r8NPl9KLlLkhNOGInBRGRNd-I7oolYq-P7IATSskhixtxu9EuUSf9nALIq-WkwIyfVerYHUqQFfbM_4c8xWVZPqZ_QNvnuBw-qm8U_m0kNAcDMFsrQ2oiGjkKKHMURK4U6nm8BQS0aKQ7J_tJNyAyWOVpWRnH7JpAQKrYmW8Sanx8 Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Openstack-Nova-Api-Version: 2.20 Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: d22d9f4004394e1cbcd0a2afffd114b1 Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-46890877 Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:37:01.959956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:37:01.961713 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d22d9f4004394e1cbcd0a2afffd114b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d22d9f4004394e1cbcd0a2afffd114b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d22d9f4004394e1cbcd0a2afffd114b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d22d9f4004394e1cbcd0a2afffd114b1"}]}] Aug 19 16:37:01.961713 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-AttachVolumeShelveTestJSON-46890877 Aug 19 16:37:01.961713 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: d22d9f4004394e1cbcd0a2afffd114b1 Aug 19 16:37:01.961713 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-46890877 Aug 19 16:37:01.961713 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-AttachVolumeShelveTestJSON-46890877-project Aug 19 16:37:01.961713 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:37:01.961713 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:37:01.961713 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: e09fd34737af41dc972d806dc3b0705e Aug 19 16:37:01.961713 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-AttachVolumeShelveTestJSON-46890877-project Aug 19 16:37:01.961713 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:37:01.961713 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance 894cc1e2-8a17-4de0-8127-b929095837d8 could not be found. Aug 19 16:37:01.961713 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': '894cc1e2-8a17-4de0-8127-b929095837d8'} Aug 19 16:37:01.962636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:37:01.962636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:37:01.962636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:37:01.962636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:37:01.962636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:37:01.962636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:37:01.962636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:37:01.962636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:37:01.962636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:37:01.962636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:37:01.962636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 894cc1e2-8a17-4de0-8127-b929095837d8 could not be found. Aug 19 16:37:01.962636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:37:01.962636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:37:01.962636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:37:01.962636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:37:01.962636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:37:01.962636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:37:01.962636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:37:01.962636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:37:01.962636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:37:01.964094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:37:01.964094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:37:01.964094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:37:01.964094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:37:01.964094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:37:01.964094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:37:01.964094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:37:01.964094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 894cc1e2-8a17-4de0-8127-b929095837d8 could not be found. Aug 19 16:37:01.964094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:37:01.964094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:37:01.964094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:37:01.964094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:37:01.964094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:37:01.964094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:37:01.964094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:37:01.964094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:37:01.964094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 894cc1e2-8a17-4de0-8127-b929095837d8 could not be found. Aug 19 16:37:01.964094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:37:01.974246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1f70c647-150e-410f-816f-1e65e2209651 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Returning 404 to user: Instance 894cc1e2-8a17-4de0-8127-b929095837d8 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:37:01.975368 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1f70c647-150e-410f-816f-1e65e2209651 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 404 len: 111 microversion: 2.20 time: 0.071619 Aug 19 16:37:01.976425 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 405/807] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:37:01 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 19 16:37:01.984855 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-5bd3a934-4bd5-425c-be5d-23d34b978e9a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '.version_select at 0x7fb022889430>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:02.011603 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-5bd3a934-4bd5-425c-be5d-23d34b978e9a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-822974724" status: 204 len: 0 microversion: 2.20 time: 0.030646 Aug 19 16:37:02.012793 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 403/808] 10.222.0.55 () {60 vars in 1259 bytes} [Fri Aug 19 16:37:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-822974724 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 19 16:37:02.351619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-0fa716a2-9c74-4d06-81b4-17f6a230fec8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:02.352254 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-0fa716a2-9c74-4d06-81b4-17f6a230fec8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:02.361017 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0fa716a2-9c74-4d06-81b4-17f6a230fec8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:02.362361 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0fa716a2-9c74-4d06-81b4-17f6a230fec8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:02.363015 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0fa716a2-9c74-4d06-81b4-17f6a230fec8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:02.363919 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0fa716a2-9c74-4d06-81b4-17f6a230fec8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:02.364565 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0fa716a2-9c74-4d06-81b4-17f6a230fec8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:02.365206 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0fa716a2-9c74-4d06-81b4-17f6a230fec8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:02.675430 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-0fa716a2-9c74-4d06-81b4-17f6a230fec8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:02.685147 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-0fa716a2-9c74-4d06-81b4-17f6a230fec8 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1678 microversion: 2.1 time: 0.340023 Aug 19 16:37:02.686266 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 406/809] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:02 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1678 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:03.112220 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-deba3235-a1aa-4167-b65a-0d96d2616321 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Action: 'create', calling method: .version_select at 0x7fb01e01d430>, body: {"keypair": {"name": "tempest-keypair-369081726", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoAm/u76gsq1xSZ4H72m5VWPktplX7HMprja8FIHyXCmpCLa6WQCfjyk6n4o4apsrxsGARFYAi3ofNIkJ8to9W1cW6vtkMIHqu/fsNsQZ3mzKZFmNU9ZHYtx0vg/ZfR3w=="}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:37:03.130816 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-deba3235-a1aa-4167-b65a-0d96d2616321 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Getting quotas for project d22d9f4004394e1cbcd0a2afffd114b1. Resources: {'key_pairs'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:37:03.135681 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-deba3235-a1aa-4167-b65a-0d96d2616321 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Getting quotas for user e09fd34737af41dc972d806dc3b0705e and project d22d9f4004394e1cbcd0a2afffd114b1. Resources: {'key_pairs'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:37:03.165634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-deba3235-a1aa-4167-b65a-0d96d2616321 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.057527 Aug 19 16:37:03.167753 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 404/810] 10.222.0.55 () {62 vars in 1200 bytes} [Fri Aug 19 16:37:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 19 16:37:03.711117 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b9037ac2-29b6-4c22-951c-33b227dc8947 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:03.712312 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-b9037ac2-29b6-4c22-951c-33b227dc8947 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:03.719049 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b9037ac2-29b6-4c22-951c-33b227dc8947 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:03.719811 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b9037ac2-29b6-4c22-951c-33b227dc8947 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:03.720404 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b9037ac2-29b6-4c22-951c-33b227dc8947 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:03.721946 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b9037ac2-29b6-4c22-951c-33b227dc8947 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:03.722559 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b9037ac2-29b6-4c22-951c-33b227dc8947 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:03.723140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b9037ac2-29b6-4c22-951c-33b227dc8947 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:03.954432 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b9037ac2-29b6-4c22-951c-33b227dc8947 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:03.965407 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b9037ac2-29b6-4c22-951c-33b227dc8947 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1678 microversion: 2.1 time: 0.257899 Aug 19 16:37:03.966982 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 407/811] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:03 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1678 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:04.835093 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1fbfe9b6-0ece-4d06-81a3-30a3f0b85567 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1084504126", "imageRef": "da4af7b7-e205-4511-ad99-3478c2523f74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "59a32018-c862-4804-a80b-75128ffed9f8"}], "security_groups": [{"name": "tempest-securitygroup--30721829"}], "key_name": "tempest-keypair-369081726", "user_data": "}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:37:04.971378 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.network.neutron [None req-1fbfe9b6-0ece-4d06-81a3-30a3f0b85567 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] validate_networks() for [('59a32018-c862-4804-a80b-75128ffed9f8', None, None, None, None, None)] {{(pid=127285) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:37:04.989048 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7d8a71d0-d9b9-446d-b039-0bdb1f251b59 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:04.989629 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7d8a71d0-d9b9-446d-b039-0bdb1f251b59 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:04.999248 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7d8a71d0-d9b9-446d-b039-0bdb1f251b59 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:04.999728 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7d8a71d0-d9b9-446d-b039-0bdb1f251b59 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:05.000148 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7d8a71d0-d9b9-446d-b039-0bdb1f251b59 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:05.000872 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7d8a71d0-d9b9-446d-b039-0bdb1f251b59 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:05.001626 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7d8a71d0-d9b9-446d-b039-0bdb1f251b59 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:05.003324 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7d8a71d0-d9b9-446d-b039-0bdb1f251b59 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:05.185360 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7d8a71d0-d9b9-446d-b039-0bdb1f251b59 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:05.195996 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7d8a71d0-d9b9-446d-b039-0bdb1f251b59 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1678 microversion: 2.1 time: 0.212577 Aug 19 16:37:05.196999 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 408/812] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:04 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:37:05.623352 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-1fbfe9b6-0ece-4d06-81a3-30a3f0b85567 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Flavor limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:37:05.624245 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-1fbfe9b6-0ece-4d06-81a3-30a3f0b85567 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Image limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:37:05.624959 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-1fbfe9b6-0ece-4d06-81a3-30a3f0b85567 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Flavor pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:37:05.625433 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-1fbfe9b6-0ece-4d06-81a3-30a3f0b85567 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Image pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:37:05.626456 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-1fbfe9b6-0ece-4d06-81a3-30a3f0b85567 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:37:05.630184 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:05.646196 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1fbfe9b6-0ece-4d06-81a3-30a3f0b85567 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:05.648571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1fbfe9b6-0ece-4d06-81a3-30a3f0b85567 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:05.649041 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1fbfe9b6-0ece-4d06-81a3-30a3f0b85567 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:05.649793 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1fbfe9b6-0ece-4d06-81a3-30a3f0b85567 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:05.650251 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1fbfe9b6-0ece-4d06-81a3-30a3f0b85567 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:05.650871 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1fbfe9b6-0ece-4d06-81a3-30a3f0b85567 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:05.675721 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-1fbfe9b6-0ece-4d06-81a3-30a3f0b85567 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Getting quotas for project d22d9f4004394e1cbcd0a2afffd114b1. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:37:05.682147 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-1fbfe9b6-0ece-4d06-81a3-30a3f0b85567 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Getting quotas for user e09fd34737af41dc972d806dc3b0705e and project d22d9f4004394e1cbcd0a2afffd114b1. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:37:05.687078 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-64b2e409-b3c9-40e7-846c-cb7b5f1db8ec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:37:05.690383 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-64b2e409-b3c9-40e7-846c-cb7b5f1db8ec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:05.697343 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-1fbfe9b6-0ece-4d06-81a3-30a3f0b85567 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Going to run 1 instances... {{(pid=127285) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:37:05.700377 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-1fbfe9b6-0ece-4d06-81a3-30a3f0b85567 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='da4af7b7-e205-4511-ad99-3478c2523f74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127285) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:37:05.706062 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-64b2e409-b3c9-40e7-846c-cb7b5f1db8ec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:05.706928 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-64b2e409-b3c9-40e7-846c-cb7b5f1db8ec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:05.708671 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-64b2e409-b3c9-40e7-846c-cb7b5f1db8ec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:05.711750 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-64b2e409-b3c9-40e7-846c-cb7b5f1db8ec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:05.712603 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-64b2e409-b3c9-40e7-846c-cb7b5f1db8ec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:05.713958 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-64b2e409-b3c9-40e7-846c-cb7b5f1db8ec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:05.773411 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-1fbfe9b6-0ece-4d06-81a3-30a3f0b85567 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.943663 Aug 19 16:37:05.780095 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 405/813] 10.222.0.55 () {62 vars in 1188 bytes} [Fri Aug 19 16:37:04 2022] POST /compute/v2.1/servers => generated 400 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 19 16:37:05.788248 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-263c1620-e5f4-4394-b3b0-f40da8e75328 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:05.789227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-263c1620-e5f4-4394-b3b0-f40da8e75328 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:05.828237 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-64b2e409-b3c9-40e7-846c-cb7b5f1db8ec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "POST /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/action" status: 202 len: 0 microversion: 2.1 time: 0.145679 Aug 19 16:37:05.830115 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 409/814] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Aug 19 16:37:05 2022] POST /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:37:05.846483 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-be643ea3-096b-4aa8-a59b-c8fccfa02457 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:05.847617 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-be643ea3-096b-4aa8-a59b-c8fccfa02457 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:05.856811 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-be643ea3-096b-4aa8-a59b-c8fccfa02457 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:05.857615 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-be643ea3-096b-4aa8-a59b-c8fccfa02457 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:05.858257 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-be643ea3-096b-4aa8-a59b-c8fccfa02457 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:05.859897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-be643ea3-096b-4aa8-a59b-c8fccfa02457 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:05.860673 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-be643ea3-096b-4aa8-a59b-c8fccfa02457 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:05.862366 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-be643ea3-096b-4aa8-a59b-c8fccfa02457 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:05.892655 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-263c1620-e5f4-4394-b3b0-f40da8e75328 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:05.915288 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-263c1620-e5f4-4394-b3b0-f40da8e75328 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:05.917699 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-263c1620-e5f4-4394-b3b0-f40da8e75328 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:05.919144 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-263c1620-e5f4-4394-b3b0-f40da8e75328 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1281 microversion: 2.20 time: 0.137494 Aug 19 16:37:05.919763 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 406/815] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:37:05 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1281 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:37:06.222395 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f9133e18-365d-4a09-b1d7-1cd04a02e4dd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:06.224156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f9133e18-365d-4a09-b1d7-1cd04a02e4dd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:06.225492 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-be643ea3-096b-4aa8-a59b-c8fccfa02457 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:06.254877 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f9133e18-365d-4a09-b1d7-1cd04a02e4dd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:06.255580 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f9133e18-365d-4a09-b1d7-1cd04a02e4dd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:06.256619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-be643ea3-096b-4aa8-a59b-c8fccfa02457 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1750 microversion: 2.1 time: 0.419408 Aug 19 16:37:06.257067 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f9133e18-365d-4a09-b1d7-1cd04a02e4dd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:06.259199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 410/816] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:05 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1750 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:06.260042 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f9133e18-365d-4a09-b1d7-1cd04a02e4dd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:06.261907 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f9133e18-365d-4a09-b1d7-1cd04a02e4dd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:06.262838 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f9133e18-365d-4a09-b1d7-1cd04a02e4dd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:06.493286 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f9133e18-365d-4a09-b1d7-1cd04a02e4dd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:06.502327 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f9133e18-365d-4a09-b1d7-1cd04a02e4dd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1678 microversion: 2.1 time: 0.287232 Aug 19 16:37:06.503799 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 407/817] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:06 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1678 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:06.944051 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d39396e7-b64e-4e88-bf00-6d86f76ec6a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:06.944734 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d39396e7-b64e-4e88-bf00-6d86f76ec6a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:06.954962 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d39396e7-b64e-4e88-bf00-6d86f76ec6a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:06.969108 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d39396e7-b64e-4e88-bf00-6d86f76ec6a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:06.969684 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d39396e7-b64e-4e88-bf00-6d86f76ec6a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:06.970514 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d39396e7-b64e-4e88-bf00-6d86f76ec6a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:06.971251 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d39396e7-b64e-4e88-bf00-6d86f76ec6a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:06.971755 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d39396e7-b64e-4e88-bf00-6d86f76ec6a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:07.042766 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d39396e7-b64e-4e88-bf00-6d86f76ec6a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:07.056565 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d39396e7-b64e-4e88-bf00-6d86f76ec6a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:07.059033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d39396e7-b64e-4e88-bf00-6d86f76ec6a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:07.061129 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d39396e7-b64e-4e88-bf00-6d86f76ec6a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1277 microversion: 2.20 time: 0.121810 Aug 19 16:37:07.062436 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 411/818] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:37:06 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:37:07.284502 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2d94dad6-e619-4bc9-abc4-06b2f4f0743a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:07.285327 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2d94dad6-e619-4bc9-abc4-06b2f4f0743a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:07.294330 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2d94dad6-e619-4bc9-abc4-06b2f4f0743a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:07.295268 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2d94dad6-e619-4bc9-abc4-06b2f4f0743a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:07.295889 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2d94dad6-e619-4bc9-abc4-06b2f4f0743a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:07.296809 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2d94dad6-e619-4bc9-abc4-06b2f4f0743a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:07.297415 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2d94dad6-e619-4bc9-abc4-06b2f4f0743a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:07.297996 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2d94dad6-e619-4bc9-abc4-06b2f4f0743a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:07.620221 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2d94dad6-e619-4bc9-abc4-06b2f4f0743a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:07.631513 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2d94dad6-e619-4bc9-abc4-06b2f4f0743a tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1755 microversion: 2.1 time: 0.352986 Aug 19 16:37:07.633777 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 408/819] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:07 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1755 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:07.755649 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7221964f-85a0-48c5-9cc4-5dcd1392ed41 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:07.756257 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7221964f-85a0-48c5-9cc4-5dcd1392ed41 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:07.762850 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7221964f-85a0-48c5-9cc4-5dcd1392ed41 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:07.763597 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7221964f-85a0-48c5-9cc4-5dcd1392ed41 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:07.764210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7221964f-85a0-48c5-9cc4-5dcd1392ed41 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:07.765147 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7221964f-85a0-48c5-9cc4-5dcd1392ed41 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:07.765603 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7221964f-85a0-48c5-9cc4-5dcd1392ed41 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:07.766029 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7221964f-85a0-48c5-9cc4-5dcd1392ed41 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:07.957931 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7221964f-85a0-48c5-9cc4-5dcd1392ed41 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:07.966470 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7221964f-85a0-48c5-9cc4-5dcd1392ed41 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1655 microversion: 2.1 time: 0.445210 Aug 19 16:37:07.969724 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 412/820] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:07 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1655 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:07.994501 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8a1f191c-b9ff-4fa9-992d-4f9e95246419 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:37:08.002934 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8a1f191c-b9ff-4fa9-992d-4f9e95246419 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:08.003472 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8a1f191c-b9ff-4fa9-992d-4f9e95246419 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:08.003958 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8a1f191c-b9ff-4fa9-992d-4f9e95246419 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:08.036787 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8a1f191c-b9ff-4fa9-992d-4f9e95246419 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Going to try to start instance {{(pid=127285) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 19 16:37:08.042126 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:08.095788 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8a640c2a-6da7-4ace-8672-46a3704556d3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:08.096867 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8a640c2a-6da7-4ace-8672-46a3704556d3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:08.097362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8a1f191c-b9ff-4fa9-992d-4f9e95246419 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "POST /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199/action" status: 202 len: 0 microversion: 2.1 time: 0.104715 Aug 19 16:37:08.101691 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 409/821] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Aug 19 16:37:07 2022] POST /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:37:08.105920 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8a640c2a-6da7-4ace-8672-46a3704556d3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:08.108296 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-481e7143-ebd6-42b2-a672-2de9c1f757c7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:08.108711 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8a640c2a-6da7-4ace-8672-46a3704556d3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:08.109192 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8a640c2a-6da7-4ace-8672-46a3704556d3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:08.109697 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-481e7143-ebd6-42b2-a672-2de9c1f757c7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:08.113885 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8a640c2a-6da7-4ace-8672-46a3704556d3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:08.114442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8a640c2a-6da7-4ace-8672-46a3704556d3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:08.115948 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8a640c2a-6da7-4ace-8672-46a3704556d3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:08.119684 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-481e7143-ebd6-42b2-a672-2de9c1f757c7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:08.120576 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-481e7143-ebd6-42b2-a672-2de9c1f757c7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:08.121067 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-481e7143-ebd6-42b2-a672-2de9c1f757c7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:08.121788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-481e7143-ebd6-42b2-a672-2de9c1f757c7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:08.122247 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-481e7143-ebd6-42b2-a672-2de9c1f757c7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:08.122675 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-481e7143-ebd6-42b2-a672-2de9c1f757c7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:08.254394 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8a640c2a-6da7-4ace-8672-46a3704556d3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:08.265305 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8a640c2a-6da7-4ace-8672-46a3704556d3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:08.267669 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8a640c2a-6da7-4ace-8672-46a3704556d3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:08.269745 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8a640c2a-6da7-4ace-8672-46a3704556d3 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1339 microversion: 2.20 time: 0.178581 Aug 19 16:37:08.272898 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 413/822] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:37:08 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1339 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:37:08.567972 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-481e7143-ebd6-42b2-a672-2de9c1f757c7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:08.594746 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-481e7143-ebd6-42b2-a672-2de9c1f757c7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1664 microversion: 2.1 time: 0.491584 Aug 19 16:37:08.595417 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 410/823] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:08 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1664 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:08.654996 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-fc2aac47-6277-4c4f-80a5-1195f9ba94dc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:08.655950 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-fc2aac47-6277-4c4f-80a5-1195f9ba94dc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:08.664595 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fc2aac47-6277-4c4f-80a5-1195f9ba94dc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:08.665347 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fc2aac47-6277-4c4f-80a5-1195f9ba94dc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:08.665925 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fc2aac47-6277-4c4f-80a5-1195f9ba94dc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:08.666821 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fc2aac47-6277-4c4f-80a5-1195f9ba94dc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:08.667617 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fc2aac47-6277-4c4f-80a5-1195f9ba94dc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:08.668188 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fc2aac47-6277-4c4f-80a5-1195f9ba94dc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:09.099029 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-fc2aac47-6277-4c4f-80a5-1195f9ba94dc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:09.112100 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-fc2aac47-6277-4c4f-80a5-1195f9ba94dc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1755 microversion: 2.1 time: 0.462462 Aug 19 16:37:09.125069 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 414/824] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:08 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1755 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:09.299032 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e7203f8d-5a80-4f23-bbd1-2b88f5531c8e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:09.299664 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e7203f8d-5a80-4f23-bbd1-2b88f5531c8e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:09.324229 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e7203f8d-5a80-4f23-bbd1-2b88f5531c8e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:09.324746 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e7203f8d-5a80-4f23-bbd1-2b88f5531c8e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:09.325218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e7203f8d-5a80-4f23-bbd1-2b88f5531c8e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:09.325942 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e7203f8d-5a80-4f23-bbd1-2b88f5531c8e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:09.326403 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e7203f8d-5a80-4f23-bbd1-2b88f5531c8e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:09.326833 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e7203f8d-5a80-4f23-bbd1-2b88f5531c8e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:09.616798 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-4f1b9738-f581-4481-b6d1-019aeddb9697 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:09.618030 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-4f1b9738-f581-4481-b6d1-019aeddb9697 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:09.627958 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f1b9738-f581-4481-b6d1-019aeddb9697 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:09.628446 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f1b9738-f581-4481-b6d1-019aeddb9697 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:09.628905 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f1b9738-f581-4481-b6d1-019aeddb9697 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:09.629612 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f1b9738-f581-4481-b6d1-019aeddb9697 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:09.630143 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f1b9738-f581-4481-b6d1-019aeddb9697 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:09.630467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f1b9738-f581-4481-b6d1-019aeddb9697 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:09.965246 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e7203f8d-5a80-4f23-bbd1-2b88f5531c8e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:09.978311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e7203f8d-5a80-4f23-bbd1-2b88f5531c8e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:09.982479 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e7203f8d-5a80-4f23-bbd1-2b88f5531c8e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:09.986158 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e7203f8d-5a80-4f23-bbd1-2b88f5531c8e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1405 microversion: 2.20 time: 0.689403 Aug 19 16:37:09.989673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 411/825] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:37:09 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1405 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:37:10.113753 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-4f1b9738-f581-4481-b6d1-019aeddb9697 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:10.125484 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-4f1b9738-f581-4481-b6d1-019aeddb9697 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1664 microversion: 2.1 time: 0.513105 Aug 19 16:37:10.138040 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3debc49a-8274-48af-95dc-9580fbbb490c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:10.139047 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-3debc49a-8274-48af-95dc-9580fbbb490c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:10.146529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 415/826] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:09 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1664 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:37:10.150447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3debc49a-8274-48af-95dc-9580fbbb490c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:10.152983 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3debc49a-8274-48af-95dc-9580fbbb490c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:10.155627 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3debc49a-8274-48af-95dc-9580fbbb490c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:10.156538 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3debc49a-8274-48af-95dc-9580fbbb490c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:10.159134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3debc49a-8274-48af-95dc-9580fbbb490c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:10.160262 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3debc49a-8274-48af-95dc-9580fbbb490c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:10.655217 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-3debc49a-8274-48af-95dc-9580fbbb490c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:10.670895 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3debc49a-8274-48af-95dc-9580fbbb490c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1755 microversion: 2.1 time: 0.536124 Aug 19 16:37:10.672025 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 412/827] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:10 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1755 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:10.691597 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-4773bbb7-6d2a-4769-898c-79fb4503bc0d req-b264d532-8483-49bc-ae09-30aacf9329c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf04a2f-684c-4e14-8def-16324168613c", "tag": "6f7012e8-b52a-4e31-8e3e-9304cba097fe"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:37:10.712391 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-4773bbb7-6d2a-4769-898c-79fb4503bc0d req-b264d532-8483-49bc-ae09-30aacf9329c8 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:10.714613 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-4773bbb7-6d2a-4769-898c-79fb4503bc0d req-b264d532-8483-49bc-ae09-30aacf9329c8 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:10.715154 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-4773bbb7-6d2a-4769-898c-79fb4503bc0d req-b264d532-8483-49bc-ae09-30aacf9329c8 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:10.739066 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:10.746005 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-4773bbb7-6d2a-4769-898c-79fb4503bc0d req-b264d532-8483-49bc-ae09-30aacf9329c8 service nova] Creating event network-changed:6f7012e8-b52a-4e31-8e3e-9304cba097fe for instance 5cf04a2f-684c-4e14-8def-16324168613c on hv-cinder-83124 Aug 19 16:37:10.756452 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-4773bbb7-6d2a-4769-898c-79fb4503bc0d req-b264d532-8483-49bc-ae09-30aacf9329c8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069723 Aug 19 16:37:10.757105 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 416/828] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:37:11.012101 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-06218402-d997-4528-8baf-67aabe4151c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:11.013841 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-06218402-d997-4528-8baf-67aabe4151c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:11.027320 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06218402-d997-4528-8baf-67aabe4151c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:11.028233 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06218402-d997-4528-8baf-67aabe4151c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:11.031490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06218402-d997-4528-8baf-67aabe4151c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:11.034436 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06218402-d997-4528-8baf-67aabe4151c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:11.035341 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06218402-d997-4528-8baf-67aabe4151c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:11.036002 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06218402-d997-4528-8baf-67aabe4151c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:11.172857 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ddcaa6cd-1ec6-46e6-a17f-9eaaaa2a2dc5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:11.174219 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ddcaa6cd-1ec6-46e6-a17f-9eaaaa2a2dc5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:11.180958 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ddcaa6cd-1ec6-46e6-a17f-9eaaaa2a2dc5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:11.181740 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ddcaa6cd-1ec6-46e6-a17f-9eaaaa2a2dc5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:11.183229 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ddcaa6cd-1ec6-46e6-a17f-9eaaaa2a2dc5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:11.184247 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ddcaa6cd-1ec6-46e6-a17f-9eaaaa2a2dc5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:11.185066 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ddcaa6cd-1ec6-46e6-a17f-9eaaaa2a2dc5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:11.185703 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ddcaa6cd-1ec6-46e6-a17f-9eaaaa2a2dc5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:11.324650 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-06218402-d997-4528-8baf-67aabe4151c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:11.342063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-06218402-d997-4528-8baf-67aabe4151c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:11.352474 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-06218402-d997-4528-8baf-67aabe4151c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:11.354014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-06218402-d997-4528-8baf-67aabe4151c8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1405 microversion: 2.20 time: 0.346547 Aug 19 16:37:11.354643 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 413/829] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:37:11 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1405 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:37:11.482831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ddcaa6cd-1ec6-46e6-a17f-9eaaaa2a2dc5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:11.493316 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ddcaa6cd-1ec6-46e6-a17f-9eaaaa2a2dc5 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1664 microversion: 2.1 time: 0.324963 Aug 19 16:37:11.508946 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 417/830] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:11 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1664 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:11.695922 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-9e1b0666-b9db-40e9-975f-b0f154b05bd2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:11.696842 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-9e1b0666-b9db-40e9-975f-b0f154b05bd2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:11.704215 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9e1b0666-b9db-40e9-975f-b0f154b05bd2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:11.705214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9e1b0666-b9db-40e9-975f-b0f154b05bd2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:11.706073 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9e1b0666-b9db-40e9-975f-b0f154b05bd2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:11.708825 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9e1b0666-b9db-40e9-975f-b0f154b05bd2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:11.709412 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9e1b0666-b9db-40e9-975f-b0f154b05bd2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:11.709846 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9e1b0666-b9db-40e9-975f-b0f154b05bd2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:11.985298 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-9e1b0666-b9db-40e9-975f-b0f154b05bd2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:12.006065 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-9e1b0666-b9db-40e9-975f-b0f154b05bd2 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1755 microversion: 2.1 time: 0.314904 Aug 19 16:37:12.024148 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 414/831] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:11 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1755 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:12.219207 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f5961f46-d630-4f13-b39d-f8d16147079a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Action: 'create', calling method: .version_select at 0x7fb01ded1c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-160800237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLZWEAc4vtE+BLe9XZ7xVQIiXC9VQstZrQpHpJWNxnKyuIUBy77A59deSRx0WerPwytyMDzHkCcnc5bUTAxGEyqFLGtwqkoY595QA7EyKRQuMuhPHubz7ZNpsYu4wr5MA=="}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:37:12.234346 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-f5961f46-d630-4f13-b39d-f8d16147079a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Getting quotas for project 5181e8549b3a439c8921319d6957f670. Resources: {'key_pairs'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:37:12.238862 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-f5961f46-d630-4f13-b39d-f8d16147079a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Getting quotas for user f989b6fded53458b85b39789a32a39e4 and project 5181e8549b3a439c8921319d6957f670. Resources: {'key_pairs'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:37:12.260654 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f5961f46-d630-4f13-b39d-f8d16147079a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.143477 Aug 19 16:37:12.261500 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 418/832] 10.222.0.55 () {60 vars in 1159 bytes} [Fri Aug 19 16:37:12 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:37:12.377986 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-36edcce8-878b-4187-acad-e916ec062749 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:12.378626 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-36edcce8-878b-4187-acad-e916ec062749 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:12.385312 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-36edcce8-878b-4187-acad-e916ec062749 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:12.385794 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-36edcce8-878b-4187-acad-e916ec062749 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:12.386226 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-36edcce8-878b-4187-acad-e916ec062749 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:12.386921 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-36edcce8-878b-4187-acad-e916ec062749 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:12.387366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-36edcce8-878b-4187-acad-e916ec062749 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:12.387783 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-36edcce8-878b-4187-acad-e916ec062749 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:12.515331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-70dfb650-4c60-4b72-9201-f7adad9951b4 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:12.515936 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-70dfb650-4c60-4b72-9201-f7adad9951b4 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:12.522950 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-70dfb650-4c60-4b72-9201-f7adad9951b4 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:12.523429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-70dfb650-4c60-4b72-9201-f7adad9951b4 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:12.524094 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-70dfb650-4c60-4b72-9201-f7adad9951b4 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:12.524802 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-70dfb650-4c60-4b72-9201-f7adad9951b4 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:12.525405 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-70dfb650-4c60-4b72-9201-f7adad9951b4 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:12.525990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-70dfb650-4c60-4b72-9201-f7adad9951b4 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:12.581744 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-36edcce8-878b-4187-acad-e916ec062749 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:12.591835 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-36edcce8-878b-4187-acad-e916ec062749 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:12.594206 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-36edcce8-878b-4187-acad-e916ec062749 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:12.596696 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-36edcce8-878b-4187-acad-e916ec062749 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1405 microversion: 2.20 time: 0.223445 Aug 19 16:37:12.605460 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 415/833] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:37:12 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1405 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:37:12.769452 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-70dfb650-4c60-4b72-9201-f7adad9951b4 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:12.778242 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-70dfb650-4c60-4b72-9201-f7adad9951b4 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1668 microversion: 2.1 time: 0.266789 Aug 19 16:37:12.793186 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 419/834] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:12 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1668 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:37:13.029081 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-096d5385-db02-4d5d-b66e-e0d9e7d97eef tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:13.030339 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-096d5385-db02-4d5d-b66e-e0d9e7d97eef tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:13.036921 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-096d5385-db02-4d5d-b66e-e0d9e7d97eef tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:13.037405 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-096d5385-db02-4d5d-b66e-e0d9e7d97eef tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:13.038051 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-096d5385-db02-4d5d-b66e-e0d9e7d97eef tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:13.038758 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-096d5385-db02-4d5d-b66e-e0d9e7d97eef tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:13.039204 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-096d5385-db02-4d5d-b66e-e0d9e7d97eef tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:13.039787 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-096d5385-db02-4d5d-b66e-e0d9e7d97eef tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:13.245525 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-096d5385-db02-4d5d-b66e-e0d9e7d97eef tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:13.255558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-096d5385-db02-4d5d-b66e-e0d9e7d97eef tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1755 microversion: 2.1 time: 0.230794 Aug 19 16:37:13.272960 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 416/835] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:13 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1755 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:13.623267 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-808dd683-d485-41ee-850a-c46659c9404a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:13.623881 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-808dd683-d485-41ee-850a-c46659c9404a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:13.631287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-808dd683-d485-41ee-850a-c46659c9404a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:13.631775 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-808dd683-d485-41ee-850a-c46659c9404a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:13.632209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-808dd683-d485-41ee-850a-c46659c9404a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:13.632933 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-808dd683-d485-41ee-850a-c46659c9404a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:13.633385 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-808dd683-d485-41ee-850a-c46659c9404a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:13.633870 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-808dd683-d485-41ee-850a-c46659c9404a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:13.786856 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-808dd683-d485-41ee-850a-c46659c9404a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:13.795335 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-808dd683-d485-41ee-850a-c46659c9404a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:13.796915 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-808dd683-d485-41ee-850a-c46659c9404a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:13.798910 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-808dd683-d485-41ee-850a-c46659c9404a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1405 microversion: 2.20 time: 0.178994 Aug 19 16:37:13.804851 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 420/836] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:37:13 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:37:14.280243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f3b7a009-ab85-4d59-a594-bbb734aedbaf tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:14.281005 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f3b7a009-ab85-4d59-a594-bbb734aedbaf tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:14.288024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f3b7a009-ab85-4d59-a594-bbb734aedbaf tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:14.288505 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f3b7a009-ab85-4d59-a594-bbb734aedbaf tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:14.288985 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f3b7a009-ab85-4d59-a594-bbb734aedbaf tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:14.289689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f3b7a009-ab85-4d59-a594-bbb734aedbaf tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:14.290146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f3b7a009-ab85-4d59-a594-bbb734aedbaf tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:14.290574 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f3b7a009-ab85-4d59-a594-bbb734aedbaf tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:14.434670 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f3b7a009-ab85-4d59-a594-bbb734aedbaf tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:14.443679 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f3b7a009-ab85-4d59-a594-bbb734aedbaf tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1755 microversion: 2.1 time: 0.167136 Aug 19 16:37:14.444161 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 417/837] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:14 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:14.820914 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d533db3c-fbf9-4871-b910-2051bec84992 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:14.821522 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d533db3c-fbf9-4871-b910-2051bec84992 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:14.828380 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d533db3c-fbf9-4871-b910-2051bec84992 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:14.828905 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d533db3c-fbf9-4871-b910-2051bec84992 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:14.829344 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d533db3c-fbf9-4871-b910-2051bec84992 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:14.830172 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d533db3c-fbf9-4871-b910-2051bec84992 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:14.830822 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d533db3c-fbf9-4871-b910-2051bec84992 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:14.831527 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d533db3c-fbf9-4871-b910-2051bec84992 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:14.993545 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d533db3c-fbf9-4871-b910-2051bec84992 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:15.002295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d533db3c-fbf9-4871-b910-2051bec84992 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:15.004458 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d533db3c-fbf9-4871-b910-2051bec84992 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:15.005604 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d533db3c-fbf9-4871-b910-2051bec84992 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1405 microversion: 2.20 time: 0.188720 Aug 19 16:37:15.011224 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 421/838] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:37:14 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1405 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:37:15.466758 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e18ba01a-e572-46a5-805c-348824bdf699 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:15.467368 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e18ba01a-e572-46a5-805c-348824bdf699 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:15.476448 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e18ba01a-e572-46a5-805c-348824bdf699 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:15.477227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e18ba01a-e572-46a5-805c-348824bdf699 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:15.477888 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e18ba01a-e572-46a5-805c-348824bdf699 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:15.478586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e18ba01a-e572-46a5-805c-348824bdf699 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:15.479031 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e18ba01a-e572-46a5-805c-348824bdf699 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:15.479447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e18ba01a-e572-46a5-805c-348824bdf699 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:15.639339 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e18ba01a-e572-46a5-805c-348824bdf699 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:15.649155 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e18ba01a-e572-46a5-805c-348824bdf699 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1755 microversion: 2.1 time: 0.186077 Aug 19 16:37:15.649738 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 418/839] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:15 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:16.042260 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ff995187-e41b-42da-99fb-680a3c680425 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:16.042870 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ff995187-e41b-42da-99fb-680a3c680425 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:16.050102 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ff995187-e41b-42da-99fb-680a3c680425 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:16.050581 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ff995187-e41b-42da-99fb-680a3c680425 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:16.051233 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ff995187-e41b-42da-99fb-680a3c680425 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:16.052054 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ff995187-e41b-42da-99fb-680a3c680425 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:16.052657 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ff995187-e41b-42da-99fb-680a3c680425 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:16.053138 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ff995187-e41b-42da-99fb-680a3c680425 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:16.215361 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ff995187-e41b-42da-99fb-680a3c680425 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:16.224264 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ff995187-e41b-42da-99fb-680a3c680425 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:16.226007 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ff995187-e41b-42da-99fb-680a3c680425 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:16.227105 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ff995187-e41b-42da-99fb-680a3c680425 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1405 microversion: 2.20 time: 0.188771 Aug 19 16:37:16.227651 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 422/840] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:37:16 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1405 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:37:16.670750 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-7424e8f8-9da3-472e-830a-e2731c34e0fc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:16.671361 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-7424e8f8-9da3-472e-830a-e2731c34e0fc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:16.673376 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=2 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:16.674278 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=12 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:16.680492 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7424e8f8-9da3-472e-830a-e2731c34e0fc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:16.681005 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7424e8f8-9da3-472e-830a-e2731c34e0fc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:16.681443 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7424e8f8-9da3-472e-830a-e2731c34e0fc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:16.682129 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7424e8f8-9da3-472e-830a-e2731c34e0fc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:16.682581 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7424e8f8-9da3-472e-830a-e2731c34e0fc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:16.683004 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7424e8f8-9da3-472e-830a-e2731c34e0fc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:16.833792 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7424e8f8-9da3-472e-830a-e2731c34e0fc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:16.841993 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-7424e8f8-9da3-472e-830a-e2731c34e0fc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1755 microversion: 2.1 time: 0.175057 Aug 19 16:37:16.842679 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 419/841] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:16 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:17.249758 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-6d7f975a-53e1-496d-a5d7-beadd85ce6e0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:17.250391 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-6d7f975a-53e1-496d-a5d7-beadd85ce6e0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:17.257091 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6d7f975a-53e1-496d-a5d7-beadd85ce6e0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:17.257564 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6d7f975a-53e1-496d-a5d7-beadd85ce6e0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:17.257992 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6d7f975a-53e1-496d-a5d7-beadd85ce6e0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:17.258667 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6d7f975a-53e1-496d-a5d7-beadd85ce6e0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:17.259109 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6d7f975a-53e1-496d-a5d7-beadd85ce6e0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:17.259522 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6d7f975a-53e1-496d-a5d7-beadd85ce6e0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:17.393943 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-6d7f975a-53e1-496d-a5d7-beadd85ce6e0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:17.405679 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-6d7f975a-53e1-496d-a5d7-beadd85ce6e0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:17.408077 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-6d7f975a-53e1-496d-a5d7-beadd85ce6e0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:17.409541 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-6d7f975a-53e1-496d-a5d7-beadd85ce6e0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1405 microversion: 2.20 time: 0.163659 Aug 19 16:37:17.410106 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 423/842] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:37:17 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:37:17.863645 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-9f9f9767-5215-4b82-80f2-27c552097f7c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:17.864248 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-9f9f9767-5215-4b82-80f2-27c552097f7c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:17.870693 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f9f9767-5215-4b82-80f2-27c552097f7c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:17.871169 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f9f9767-5215-4b82-80f2-27c552097f7c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:17.871604 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f9f9767-5215-4b82-80f2-27c552097f7c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:17.872281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f9f9767-5215-4b82-80f2-27c552097f7c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:17.872724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f9f9767-5215-4b82-80f2-27c552097f7c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:17.873170 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9f9f9767-5215-4b82-80f2-27c552097f7c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:18.014266 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-9f9f9767-5215-4b82-80f2-27c552097f7c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:18.023021 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-9f9f9767-5215-4b82-80f2-27c552097f7c tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1755 microversion: 2.1 time: 0.163453 Aug 19 16:37:18.023575 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 420/843] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:17 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:18.280553 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-c4d6b508-2325-469c-b692-abbaec290f57 req-2b721e6f-e991-4ba1-a1cb-89aed5acd159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf04a2f-684c-4e14-8def-16324168613c", "name": "network-vif-plugged", "status": "completed", "tag": "6f7012e8-b52a-4e31-8e3e-9304cba097fe"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:37:18.291155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-c4d6b508-2325-469c-b692-abbaec290f57 req-2b721e6f-e991-4ba1-a1cb-89aed5acd159 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:18.291631 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-c4d6b508-2325-469c-b692-abbaec290f57 req-2b721e6f-e991-4ba1-a1cb-89aed5acd159 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:18.292059 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-c4d6b508-2325-469c-b692-abbaec290f57 req-2b721e6f-e991-4ba1-a1cb-89aed5acd159 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:18.303560 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-c4d6b508-2325-469c-b692-abbaec290f57 req-2b721e6f-e991-4ba1-a1cb-89aed5acd159 service nova] Creating event network-vif-plugged:6f7012e8-b52a-4e31-8e3e-9304cba097fe for instance 5cf04a2f-684c-4e14-8def-16324168613c on hv-cinder-83124 Aug 19 16:37:18.308269 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-c4d6b508-2325-469c-b692-abbaec290f57 req-2b721e6f-e991-4ba1-a1cb-89aed5acd159 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031608 Aug 19 16:37:18.309022 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 424/844] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:37:18.431616 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-760ee87c-c40a-4cc0-8580-feee8e93dc16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:18.432467 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-760ee87c-c40a-4cc0-8580-feee8e93dc16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:18.440664 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-760ee87c-c40a-4cc0-8580-feee8e93dc16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:18.441317 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-760ee87c-c40a-4cc0-8580-feee8e93dc16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:18.441946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-760ee87c-c40a-4cc0-8580-feee8e93dc16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:18.442952 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-760ee87c-c40a-4cc0-8580-feee8e93dc16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:18.443409 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-760ee87c-c40a-4cc0-8580-feee8e93dc16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:18.444075 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-760ee87c-c40a-4cc0-8580-feee8e93dc16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:18.796267 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-760ee87c-c40a-4cc0-8580-feee8e93dc16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:18.805028 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-760ee87c-c40a-4cc0-8580-feee8e93dc16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:18.806449 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-760ee87c-c40a-4cc0-8580-feee8e93dc16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:18.807526 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-760ee87c-c40a-4cc0-8580-feee8e93dc16 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1405 microversion: 2.20 time: 0.379793 Aug 19 16:37:18.808077 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 421/845] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:37:18 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1405 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:37:19.043993 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-48609589-9f3a-4a4e-bbae-39ddc52fb6b4 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:19.044721 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-48609589-9f3a-4a4e-bbae-39ddc52fb6b4 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:19.051468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-48609589-9f3a-4a4e-bbae-39ddc52fb6b4 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:19.051951 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-48609589-9f3a-4a4e-bbae-39ddc52fb6b4 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:19.052390 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-48609589-9f3a-4a4e-bbae-39ddc52fb6b4 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:19.053105 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-48609589-9f3a-4a4e-bbae-39ddc52fb6b4 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:19.053563 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-48609589-9f3a-4a4e-bbae-39ddc52fb6b4 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:19.053994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-48609589-9f3a-4a4e-bbae-39ddc52fb6b4 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:19.200193 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-48609589-9f3a-4a4e-bbae-39ddc52fb6b4 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:19.209444 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-48609589-9f3a-4a4e-bbae-39ddc52fb6b4 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1755 microversion: 2.1 time: 0.169687 Aug 19 16:37:19.210017 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 425/846] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:19 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:19.829838 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-104568a4-4104-438d-b7ca-ac379452d506 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:19.830446 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-104568a4-4104-438d-b7ca-ac379452d506 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:19.836828 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-104568a4-4104-438d-b7ca-ac379452d506 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:19.837313 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-104568a4-4104-438d-b7ca-ac379452d506 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:19.837748 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-104568a4-4104-438d-b7ca-ac379452d506 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:19.838430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-104568a4-4104-438d-b7ca-ac379452d506 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:19.838936 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-104568a4-4104-438d-b7ca-ac379452d506 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:19.839305 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-104568a4-4104-438d-b7ca-ac379452d506 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:19.966924 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-104568a4-4104-438d-b7ca-ac379452d506 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:19.975122 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-104568a4-4104-438d-b7ca-ac379452d506 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:19.976646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-104568a4-4104-438d-b7ca-ac379452d506 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:19.977770 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-104568a4-4104-438d-b7ca-ac379452d506 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1405 microversion: 2.20 time: 0.152440 Aug 19 16:37:19.978327 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 422/847] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:37:19 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:37:20.231682 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-82b4995e-164b-47f6-a65b-fefee09c9266 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:20.232297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-82b4995e-164b-47f6-a65b-fefee09c9266 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:20.238933 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-82b4995e-164b-47f6-a65b-fefee09c9266 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:20.239411 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-82b4995e-164b-47f6-a65b-fefee09c9266 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:20.239845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-82b4995e-164b-47f6-a65b-fefee09c9266 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:20.240531 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-82b4995e-164b-47f6-a65b-fefee09c9266 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:20.241004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-82b4995e-164b-47f6-a65b-fefee09c9266 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:20.241478 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-82b4995e-164b-47f6-a65b-fefee09c9266 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:20.385817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-82b4995e-164b-47f6-a65b-fefee09c9266 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:20.396688 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-82b4995e-164b-47f6-a65b-fefee09c9266 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1755 microversion: 2.1 time: 0.168669 Aug 19 16:37:20.397542 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 426/848] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:20 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:21.002111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ce1c1634-21b8-43a5-b7c3-2529b3ad5588 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:21.002753 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ce1c1634-21b8-43a5-b7c3-2529b3ad5588 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:21.010334 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce1c1634-21b8-43a5-b7c3-2529b3ad5588 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:21.010818 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce1c1634-21b8-43a5-b7c3-2529b3ad5588 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:21.011293 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce1c1634-21b8-43a5-b7c3-2529b3ad5588 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:21.012025 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce1c1634-21b8-43a5-b7c3-2529b3ad5588 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:21.012473 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce1c1634-21b8-43a5-b7c3-2529b3ad5588 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:21.012929 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce1c1634-21b8-43a5-b7c3-2529b3ad5588 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:21.181300 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ce1c1634-21b8-43a5-b7c3-2529b3ad5588 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:21.190404 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ce1c1634-21b8-43a5-b7c3-2529b3ad5588 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:21.191894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ce1c1634-21b8-43a5-b7c3-2529b3ad5588 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:21.193194 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ce1c1634-21b8-43a5-b7c3-2529b3ad5588 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1596 microversion: 2.20 time: 0.197090 Aug 19 16:37:21.193797 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 423/849] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:37:20 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1596 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:37:21.222225 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1735c69d-ebfc-4575-a5db-67e5cda256f7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:21.222715 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1735c69d-ebfc-4575-a5db-67e5cda256f7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:21.228659 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1735c69d-ebfc-4575-a5db-67e5cda256f7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:21.229171 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1735c69d-ebfc-4575-a5db-67e5cda256f7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:21.229608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1735c69d-ebfc-4575-a5db-67e5cda256f7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:21.230290 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1735c69d-ebfc-4575-a5db-67e5cda256f7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:21.230742 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1735c69d-ebfc-4575-a5db-67e5cda256f7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:21.231167 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1735c69d-ebfc-4575-a5db-67e5cda256f7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:21.317127 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1735c69d-ebfc-4575-a5db-67e5cda256f7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098773 Aug 19 16:37:21.317769 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 427/850] 10.222.0.55 () {60 vars in 1316 bytes} [Fri Aug 19 16:37:21 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:37:21.419428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-523ed9b1-cfa4-4d0f-8465-e37f6af9be15 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:21.420215 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-523ed9b1-cfa4-4d0f-8465-e37f6af9be15 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:21.429638 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-523ed9b1-cfa4-4d0f-8465-e37f6af9be15 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:21.430071 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-523ed9b1-cfa4-4d0f-8465-e37f6af9be15 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:21.430571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-523ed9b1-cfa4-4d0f-8465-e37f6af9be15 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:21.431273 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-523ed9b1-cfa4-4d0f-8465-e37f6af9be15 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:21.431799 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-523ed9b1-cfa4-4d0f-8465-e37f6af9be15 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:21.432251 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-523ed9b1-cfa4-4d0f-8465-e37f6af9be15 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:21.690117 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-523ed9b1-cfa4-4d0f-8465-e37f6af9be15 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:21.699299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-523ed9b1-cfa4-4d0f-8465-e37f6af9be15 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1755 microversion: 2.1 time: 0.285763 Aug 19 16:37:21.711185 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 424/851] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:21 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1755 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:22.367394 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=4 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:22.371975 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-0a170736-bf8f-42b7-be0e-d35564772800 req-452dddfd-9ae4-4600-9f2d-e48576270510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf04a2f-684c-4e14-8def-16324168613c", "tag": "6f7012e8-b52a-4e31-8e3e-9304cba097fe"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:37:22.381950 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-0a170736-bf8f-42b7-be0e-d35564772800 req-452dddfd-9ae4-4600-9f2d-e48576270510 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:22.382552 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-0a170736-bf8f-42b7-be0e-d35564772800 req-452dddfd-9ae4-4600-9f2d-e48576270510 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:22.383213 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-0a170736-bf8f-42b7-be0e-d35564772800 req-452dddfd-9ae4-4600-9f2d-e48576270510 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:22.395018 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-0a170736-bf8f-42b7-be0e-d35564772800 req-452dddfd-9ae4-4600-9f2d-e48576270510 service nova] Creating event network-changed:6f7012e8-b52a-4e31-8e3e-9304cba097fe for instance 5cf04a2f-684c-4e14-8def-16324168613c on hv-cinder-83124 Aug 19 16:37:22.400139 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-0a170736-bf8f-42b7-be0e-d35564772800 req-452dddfd-9ae4-4600-9f2d-e48576270510 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034162 Aug 19 16:37:22.401573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 428/852] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:37:22.721871 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a4b942b9-9093-4bbf-843d-86dffda23ae4 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:22.722481 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a4b942b9-9093-4bbf-843d-86dffda23ae4 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:22.729021 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a4b942b9-9093-4bbf-843d-86dffda23ae4 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:22.729507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a4b942b9-9093-4bbf-843d-86dffda23ae4 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:22.729940 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a4b942b9-9093-4bbf-843d-86dffda23ae4 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:22.730630 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a4b942b9-9093-4bbf-843d-86dffda23ae4 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:22.731081 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a4b942b9-9093-4bbf-843d-86dffda23ae4 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:22.731504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a4b942b9-9093-4bbf-843d-86dffda23ae4 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:22.751243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:22.908549 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a4b942b9-9093-4bbf-843d-86dffda23ae4 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:22.917116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a4b942b9-9093-4bbf-843d-86dffda23ae4 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1755 microversion: 2.1 time: 0.199810 Aug 19 16:37:22.917690 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 425/853] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:22 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1755 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:23.939577 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2aa2201a-5d1a-45c5-a769-b0beb23f89fe tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:23.940312 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2aa2201a-5d1a-45c5-a769-b0beb23f89fe tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:23.948664 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2aa2201a-5d1a-45c5-a769-b0beb23f89fe tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:23.949275 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2aa2201a-5d1a-45c5-a769-b0beb23f89fe tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:23.949714 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2aa2201a-5d1a-45c5-a769-b0beb23f89fe tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:23.950409 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2aa2201a-5d1a-45c5-a769-b0beb23f89fe tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:23.950881 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2aa2201a-5d1a-45c5-a769-b0beb23f89fe tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:23.951300 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2aa2201a-5d1a-45c5-a769-b0beb23f89fe tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:24.145408 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2aa2201a-5d1a-45c5-a769-b0beb23f89fe tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:24.153441 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2aa2201a-5d1a-45c5-a769-b0beb23f89fe tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1758 microversion: 2.1 time: 0.218861 Aug 19 16:37:24.153997 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 429/854] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:23 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1758 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:30.324375 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-def533ed-572a-4750-847f-f208c40227e4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:30.324919 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-def533ed-572a-4750-847f-f208c40227e4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:30.332008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-def533ed-572a-4750-847f-f208c40227e4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:30.332495 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-def533ed-572a-4750-847f-f208c40227e4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:30.332969 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-def533ed-572a-4750-847f-f208c40227e4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:30.333658 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-def533ed-572a-4750-847f-f208c40227e4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:30.334116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-def533ed-572a-4750-847f-f208c40227e4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:30.334538 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-def533ed-572a-4750-847f-f208c40227e4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:30.414000 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.objects.instance [None req-def533ed-572a-4750-847f-f208c40227e4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lazy-loading 'services' on Instance uuid 9ed4c246-7322-49b8-9bf7-2efaacc54b0b {{(pid=127285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:37:30.484117 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-def533ed-572a-4750-847f-f208c40227e4 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/os-volume_attachments/dc04bb90-55ba-4333-bf62-023881ec57ee" status: 202 len: 0 microversion: 2.1 time: 0.163771 Aug 19 16:37:30.484724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 426/855] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Aug 19 16:37:30 2022] DELETE /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/os-volume_attachments/dc04bb90-55ba-4333-bf62-023881ec57ee => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:37:30.493387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1077b4d9-82d7-4b4c-974a-4bb559660eef tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:30.496171 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1077b4d9-82d7-4b4c-974a-4bb559660eef tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:30.502897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1077b4d9-82d7-4b4c-974a-4bb559660eef tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:30.503390 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1077b4d9-82d7-4b4c-974a-4bb559660eef tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:30.504062 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1077b4d9-82d7-4b4c-974a-4bb559660eef tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:30.505051 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1077b4d9-82d7-4b4c-974a-4bb559660eef tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:30.505579 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1077b4d9-82d7-4b4c-974a-4bb559660eef tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:30.506123 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1077b4d9-82d7-4b4c-974a-4bb559660eef tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:30.536479 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1077b4d9-82d7-4b4c-974a-4bb559660eef tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047248 Aug 19 16:37:30.537063 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 430/856] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:37:30 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:37:31.550436 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a828ec9c-c40c-4749-90ec-e418138c71d2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:31.552790 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a828ec9c-c40c-4749-90ec-e418138c71d2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:31.559286 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a828ec9c-c40c-4749-90ec-e418138c71d2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:31.559756 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a828ec9c-c40c-4749-90ec-e418138c71d2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:31.560184 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a828ec9c-c40c-4749-90ec-e418138c71d2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:31.560893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a828ec9c-c40c-4749-90ec-e418138c71d2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:31.561343 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a828ec9c-c40c-4749-90ec-e418138c71d2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:31.561763 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a828ec9c-c40c-4749-90ec-e418138c71d2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:31.592474 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a828ec9c-c40c-4749-90ec-e418138c71d2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046417 Aug 19 16:37:31.592474 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 427/857] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:37:31 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:37:32.604904 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-124223f0-c0e8-475b-bcff-d6f22502f0dd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:32.607050 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-124223f0-c0e8-475b-bcff-d6f22502f0dd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:32.610085 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:32.615262 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-124223f0-c0e8-475b-bcff-d6f22502f0dd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:32.615745 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-124223f0-c0e8-475b-bcff-d6f22502f0dd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:32.616184 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-124223f0-c0e8-475b-bcff-d6f22502f0dd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:32.616897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-124223f0-c0e8-475b-bcff-d6f22502f0dd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:32.617351 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-124223f0-c0e8-475b-bcff-d6f22502f0dd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:32.617775 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-124223f0-c0e8-475b-bcff-d6f22502f0dd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:32.647413 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-124223f0-c0e8-475b-bcff-d6f22502f0dd tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046440 Aug 19 16:37:32.647988 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 431/858] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:37:32 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 16:37:32.731504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e5107c17-f24e-4442-bd74-8c0c03957de2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:32.732028 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e5107c17-f24e-4442-bd74-8c0c03957de2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:32.738518 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e5107c17-f24e-4442-bd74-8c0c03957de2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:32.739002 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e5107c17-f24e-4442-bd74-8c0c03957de2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:32.739436 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e5107c17-f24e-4442-bd74-8c0c03957de2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:32.740137 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e5107c17-f24e-4442-bd74-8c0c03957de2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:32.740571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e5107c17-f24e-4442-bd74-8c0c03957de2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:32.741023 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e5107c17-f24e-4442-bd74-8c0c03957de2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:32.764677 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e5107c17-f24e-4442-bd74-8c0c03957de2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Going to try to terminate instance {{(pid=127285) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:37:32.838415 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e5107c17-f24e-4442-bd74-8c0c03957de2 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 204 len: 0 microversion: 2.1 time: 0.110452 Aug 19 16:37:32.838948 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 428/859] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:37:32 2022] DELETE /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:37:32.847635 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b7d1dd25-60e6-495f-8608-6e64aaacd3d8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:32.848249 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-b7d1dd25-60e6-495f-8608-6e64aaacd3d8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:32.854162 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b7d1dd25-60e6-495f-8608-6e64aaacd3d8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:32.854635 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b7d1dd25-60e6-495f-8608-6e64aaacd3d8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:32.855060 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b7d1dd25-60e6-495f-8608-6e64aaacd3d8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:32.855745 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b7d1dd25-60e6-495f-8608-6e64aaacd3d8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:32.856190 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b7d1dd25-60e6-495f-8608-6e64aaacd3d8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:32.856610 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b7d1dd25-60e6-495f-8608-6e64aaacd3d8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:32.991733 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b7d1dd25-60e6-495f-8608-6e64aaacd3d8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:32.999561 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b7d1dd25-60e6-495f-8608-6e64aaacd3d8 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1688 microversion: 2.1 time: 0.156487 Aug 19 16:37:33.000180 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 432/860] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:32 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:37:33.036642 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4331e67d-606e-4c91-a22b-bf93acf940c1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2084538714", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-160800237", "security_groups": [{"name": "tempest-secgroup-smoke-1980068120"}], "block_device_mapping_v2": [{"uuid": "f0fdf6a3-189b-4413-bfec-42e7f7d6588b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fe40a75b-64e5-47a8-bbbb-5d1e93f52142"}]}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:37:33.151109 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.network.neutron [None req-4331e67d-606e-4c91-a22b-bf93acf940c1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] validate_networks() for [('fe40a75b-64e5-47a8-bbbb-5d1e93f52142', None, None, None, None, None)] {{(pid=127285) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:37:33.514433 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-4331e67d-606e-4c91-a22b-bf93acf940c1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Flavor limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:37:33.514889 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-4331e67d-606e-4c91-a22b-bf93acf940c1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Image limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:37:33.515344 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-4331e67d-606e-4c91-a22b-bf93acf940c1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Flavor pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:37:33.516343 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-4331e67d-606e-4c91-a22b-bf93acf940c1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Image pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:37:33.516779 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-4331e67d-606e-4c91-a22b-bf93acf940c1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:37:33.525507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4331e67d-606e-4c91-a22b-bf93acf940c1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:33.525990 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4331e67d-606e-4c91-a22b-bf93acf940c1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:33.526429 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4331e67d-606e-4c91-a22b-bf93acf940c1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:33.527160 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4331e67d-606e-4c91-a22b-bf93acf940c1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:33.527621 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4331e67d-606e-4c91-a22b-bf93acf940c1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:33.528050 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4331e67d-606e-4c91-a22b-bf93acf940c1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:33.544571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-4331e67d-606e-4c91-a22b-bf93acf940c1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Getting quotas for project 5181e8549b3a439c8921319d6957f670. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:37:33.548697 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-4331e67d-606e-4c91-a22b-bf93acf940c1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Getting quotas for user f989b6fded53458b85b39789a32a39e4 and project 5181e8549b3a439c8921319d6957f670. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:37:33.608651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-4331e67d-606e-4c91-a22b-bf93acf940c1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Going to run 1 instances... {{(pid=127285) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:37:33.611390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-4331e67d-606e-4c91-a22b-bf93acf940c1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0fdf6a3-189b-4413-bfec-42e7f7d6588b',volume_size=None,volume_type=None)] {{(pid=127285) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:37:33.739309 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4331e67d-606e-4c91-a22b-bf93acf940c1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.706792 Aug 19 16:37:33.739941 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 429/861] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Aug 19 16:37:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 16:37:33.751203 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c6636c4d-eb96-4514-96b8-49e40fd263c4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:33.751809 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-c6636c4d-eb96-4514-96b8-49e40fd263c4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:33.809016 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c6636c4d-eb96-4514-96b8-49e40fd263c4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:33.816543 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c6636c4d-eb96-4514-96b8-49e40fd263c4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1094 microversion: 2.1 time: 0.069820 Aug 19 16:37:33.817129 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 433/862] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:33 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:34.019753 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-fe2f0425-5278-495f-a905-10123cafc39e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:34.020619 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-fe2f0425-5278-495f-a905-10123cafc39e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:34.027218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fe2f0425-5278-495f-a905-10123cafc39e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:34.027683 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fe2f0425-5278-495f-a905-10123cafc39e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:34.028137 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fe2f0425-5278-495f-a905-10123cafc39e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:34.028850 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fe2f0425-5278-495f-a905-10123cafc39e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:34.029300 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fe2f0425-5278-495f-a905-10123cafc39e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:34.029719 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fe2f0425-5278-495f-a905-10123cafc39e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:34.161962 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fe2f0425-5278-495f-a905-10123cafc39e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:34.169627 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-fe2f0425-5278-495f-a905-10123cafc39e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1688 microversion: 2.1 time: 0.153728 Aug 19 16:37:34.170183 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 430/863] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:34 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:34.837525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2b02225c-8897-4a78-bea9-5d23346d3d46 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:34.838157 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2b02225c-8897-4a78-bea9-5d23346d3d46 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:34.846232 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2b02225c-8897-4a78-bea9-5d23346d3d46 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:34.846845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2b02225c-8897-4a78-bea9-5d23346d3d46 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:34.847291 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2b02225c-8897-4a78-bea9-5d23346d3d46 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:34.847972 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2b02225c-8897-4a78-bea9-5d23346d3d46 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:34.848420 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2b02225c-8897-4a78-bea9-5d23346d3d46 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:34.848874 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2b02225c-8897-4a78-bea9-5d23346d3d46 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:34.908536 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2b02225c-8897-4a78-bea9-5d23346d3d46 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:34.916192 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2b02225c-8897-4a78-bea9-5d23346d3d46 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1144 microversion: 2.1 time: 0.082687 Aug 19 16:37:34.916743 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 434/864] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:34 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:35.192286 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6de9d4f9-3de2-44d0-aa02-7666c6ef3fa9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:35.192821 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6de9d4f9-3de2-44d0-aa02-7666c6ef3fa9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:35.199908 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6de9d4f9-3de2-44d0-aa02-7666c6ef3fa9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:35.200398 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6de9d4f9-3de2-44d0-aa02-7666c6ef3fa9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:35.200938 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6de9d4f9-3de2-44d0-aa02-7666c6ef3fa9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:35.201675 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6de9d4f9-3de2-44d0-aa02-7666c6ef3fa9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:35.202163 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6de9d4f9-3de2-44d0-aa02-7666c6ef3fa9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:35.202593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6de9d4f9-3de2-44d0-aa02-7666c6ef3fa9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:35.331124 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6de9d4f9-3de2-44d0-aa02-7666c6ef3fa9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:35.338815 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6de9d4f9-3de2-44d0-aa02-7666c6ef3fa9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1688 microversion: 2.1 time: 0.150428 Aug 19 16:37:35.343306 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 431/865] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:35 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:35.936172 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8a2109d5-b377-48fc-87f2-6c1b224e482e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:35.936717 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8a2109d5-b377-48fc-87f2-6c1b224e482e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:35.943868 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8a2109d5-b377-48fc-87f2-6c1b224e482e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:35.944358 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8a2109d5-b377-48fc-87f2-6c1b224e482e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:35.944821 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8a2109d5-b377-48fc-87f2-6c1b224e482e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:35.945514 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8a2109d5-b377-48fc-87f2-6c1b224e482e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:35.945971 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8a2109d5-b377-48fc-87f2-6c1b224e482e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:35.946648 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8a2109d5-b377-48fc-87f2-6c1b224e482e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:36.006283 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8a2109d5-b377-48fc-87f2-6c1b224e482e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:36.013849 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8a2109d5-b377-48fc-87f2-6c1b224e482e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1144 microversion: 2.1 time: 0.081643 Aug 19 16:37:36.014405 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 435/866] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:35 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:36.361011 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f758c484-f47d-46ab-a4c0-57fce9467e32 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:36.361621 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f758c484-f47d-46ab-a4c0-57fce9467e32 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:36.363986 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:36.369210 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f758c484-f47d-46ab-a4c0-57fce9467e32 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:36.369691 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f758c484-f47d-46ab-a4c0-57fce9467e32 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:36.370125 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f758c484-f47d-46ab-a4c0-57fce9467e32 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:36.370835 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f758c484-f47d-46ab-a4c0-57fce9467e32 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:36.371287 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f758c484-f47d-46ab-a4c0-57fce9467e32 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:36.371710 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f758c484-f47d-46ab-a4c0-57fce9467e32 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:36.503522 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f758c484-f47d-46ab-a4c0-57fce9467e32 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:36.511911 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f758c484-f47d-46ab-a4c0-57fce9467e32 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1688 microversion: 2.1 time: 0.155312 Aug 19 16:37:36.512470 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 432/867] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:36 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:37.035025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ea825eed-db91-4954-99e3-b30e37686dd2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:37.035623 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ea825eed-db91-4954-99e3-b30e37686dd2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:37.042577 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea825eed-db91-4954-99e3-b30e37686dd2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:37.043046 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea825eed-db91-4954-99e3-b30e37686dd2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:37.043474 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea825eed-db91-4954-99e3-b30e37686dd2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:37.044159 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea825eed-db91-4954-99e3-b30e37686dd2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:37.044603 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea825eed-db91-4954-99e3-b30e37686dd2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:37.045047 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea825eed-db91-4954-99e3-b30e37686dd2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:37.105179 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ea825eed-db91-4954-99e3-b30e37686dd2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:37.112827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ea825eed-db91-4954-99e3-b30e37686dd2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1136 microversion: 2.1 time: 0.082307 Aug 19 16:37:37.113395 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 436/868] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:37 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1136 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:37.532679 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ad684de7-d767-4a54-8b1e-498c8819f65f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:37.533318 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ad684de7-d767-4a54-8b1e-498c8819f65f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:37.539656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad684de7-d767-4a54-8b1e-498c8819f65f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:37.540135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad684de7-d767-4a54-8b1e-498c8819f65f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:37.540569 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad684de7-d767-4a54-8b1e-498c8819f65f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:37.541402 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad684de7-d767-4a54-8b1e-498c8819f65f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:37.541858 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad684de7-d767-4a54-8b1e-498c8819f65f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:37.542282 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ad684de7-d767-4a54-8b1e-498c8819f65f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:37.670825 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ad684de7-d767-4a54-8b1e-498c8819f65f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:37.679169 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ad684de7-d767-4a54-8b1e-498c8819f65f tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1688 microversion: 2.1 time: 0.150369 Aug 19 16:37:37.679725 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 433/869] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:37 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:38.132820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-9b947b55-0102-48d5-b7f2-b4ec01772eb4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:38.133431 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-9b947b55-0102-48d5-b7f2-b4ec01772eb4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:38.139689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9b947b55-0102-48d5-b7f2-b4ec01772eb4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:38.140295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9b947b55-0102-48d5-b7f2-b4ec01772eb4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:38.140851 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9b947b55-0102-48d5-b7f2-b4ec01772eb4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:38.141550 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9b947b55-0102-48d5-b7f2-b4ec01772eb4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:38.142002 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9b947b55-0102-48d5-b7f2-b4ec01772eb4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:38.142426 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9b947b55-0102-48d5-b7f2-b4ec01772eb4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:38.146562 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=100 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:38.222152 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-9b947b55-0102-48d5-b7f2-b4ec01772eb4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:38.232577 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-9b947b55-0102-48d5-b7f2-b4ec01772eb4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1210 microversion: 2.1 time: 0.103577 Aug 19 16:37:38.245498 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 437/870] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:38 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1210 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:38.701194 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c229bc0b-c953-4700-9587-d9190484029d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:38.701815 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-c229bc0b-c953-4700-9587-d9190484029d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:38.711057 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c229bc0b-c953-4700-9587-d9190484029d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:38.711553 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c229bc0b-c953-4700-9587-d9190484029d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:38.712049 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c229bc0b-c953-4700-9587-d9190484029d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:38.712792 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c229bc0b-c953-4700-9587-d9190484029d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:38.722742 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-795592d5-5eeb-4a7e-b132-e5902e1da1c2 req-8267379a-e543-4c63-98db-1234975aa652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed4c246-7322-49b8-9bf7-2efaacc54b0b", "name": "network-vif-deleted", "tag": "fe37ffff-6942-4410-8583-71fc27f97e1b"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:37:38.725940 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c229bc0b-c953-4700-9587-d9190484029d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:38.726601 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c229bc0b-c953-4700-9587-d9190484029d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:38.742683 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-795592d5-5eeb-4a7e-b132-e5902e1da1c2 req-8267379a-e543-4c63-98db-1234975aa652 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:38.743174 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-795592d5-5eeb-4a7e-b132-e5902e1da1c2 req-8267379a-e543-4c63-98db-1234975aa652 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:38.743602 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-795592d5-5eeb-4a7e-b132-e5902e1da1c2 req-8267379a-e543-4c63-98db-1234975aa652 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:38.814471 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-795592d5-5eeb-4a7e-b132-e5902e1da1c2 req-8267379a-e543-4c63-98db-1234975aa652 service nova] Creating event network-vif-deleted:fe37ffff-6942-4410-8583-71fc27f97e1b for instance 9ed4c246-7322-49b8-9bf7-2efaacc54b0b on hv-cinder-83124 Aug 19 16:37:38.824520 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-795592d5-5eeb-4a7e-b132-e5902e1da1c2 req-8267379a-e543-4c63-98db-1234975aa652 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216694 Aug 19 16:37:38.825900 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 434/871] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:37:38.860123 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c229bc0b-c953-4700-9587-d9190484029d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:38.872787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c229bc0b-c953-4700-9587-d9190484029d tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 200 len: 1329 microversion: 2.1 time: 0.173548 Aug 19 16:37:38.875116 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 438/872] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:38 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 1329 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:39.256156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-9bb94568-72f5-45a4-8668-bdf679fe5119 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:39.257005 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-9bb94568-72f5-45a4-8668-bdf679fe5119 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:39.263405 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9bb94568-72f5-45a4-8668-bdf679fe5119 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:39.263888 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9bb94568-72f5-45a4-8668-bdf679fe5119 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:39.264319 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9bb94568-72f5-45a4-8668-bdf679fe5119 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:39.265637 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9bb94568-72f5-45a4-8668-bdf679fe5119 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:39.266306 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9bb94568-72f5-45a4-8668-bdf679fe5119 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:39.266888 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9bb94568-72f5-45a4-8668-bdf679fe5119 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:39.505231 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-9bb94568-72f5-45a4-8668-bdf679fe5119 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:39.514333 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-9bb94568-72f5-45a4-8668-bdf679fe5119 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1278 microversion: 2.1 time: 0.262378 Aug 19 16:37:39.517129 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 435/873] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:39 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1278 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:39.621093 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-eb3820f2-045c-4f18-aa76-5ed6e8ce3cae req-9519b915-e12b-42ae-9a93-3903aaabc481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f", "tag": "494a4e31-f22f-4879-99a8-4f1e34a92a8e"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:37:39.646813 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-eb3820f2-045c-4f18-aa76-5ed6e8ce3cae req-9519b915-e12b-42ae-9a93-3903aaabc481 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:39.647385 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-eb3820f2-045c-4f18-aa76-5ed6e8ce3cae req-9519b915-e12b-42ae-9a93-3903aaabc481 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:39.647900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-eb3820f2-045c-4f18-aa76-5ed6e8ce3cae req-9519b915-e12b-42ae-9a93-3903aaabc481 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:39.665761 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-eb3820f2-045c-4f18-aa76-5ed6e8ce3cae req-9519b915-e12b-42ae-9a93-3903aaabc481 service nova] Creating event network-changed:494a4e31-f22f-4879-99a8-4f1e34a92a8e for instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f on hv-cinder-83124 Aug 19 16:37:39.671095 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-eb3820f2-045c-4f18-aa76-5ed6e8ce3cae req-9519b915-e12b-42ae-9a93-3903aaabc481 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152161 Aug 19 16:37:39.672862 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 439/874] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:37:39.901719 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8b84adb6-2d01-41ba-8d99-956c0afee09a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:39.902281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8b84adb6-2d01-41ba-8d99-956c0afee09a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 9ed4c246-7322-49b8-9bf7-2efaacc54b0b] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:39.908725 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8b84adb6-2d01-41ba-8d99-956c0afee09a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:39.909247 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8b84adb6-2d01-41ba-8d99-956c0afee09a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:39.909703 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8b84adb6-2d01-41ba-8d99-956c0afee09a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:39.910398 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8b84adb6-2d01-41ba-8d99-956c0afee09a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:39.910843 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8b84adb6-2d01-41ba-8d99-956c0afee09a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:39.911261 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8b84adb6-2d01-41ba-8d99-956c0afee09a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:39.925892 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-8b84adb6-2d01-41ba-8d99-956c0afee09a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] HTTP exception thrown: Instance 9ed4c246-7322-49b8-9bf7-2efaacc54b0b could not be found. Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8b84adb6-2d01-41ba-8d99-956c0afee09a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Request method failure captured: Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b HTTP/1.1 Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7sC2YMsastFwF5KHrblHGiieD2S6sdzYymMS54J0x8Vt4lT84xG-4lz_ihMmAVoylGBgEjsioBmjrEY0M57P2KMvM72KxZwA4DIrU64AxkuAJ1z0DkabuEtOI2EukBYULCeMuCjhjcFFPoj2rUEBN2R8sCo70cp1AnirNniwWFQth0 Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: b5638f78ab9440479a209d0023e6d0bd Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1328462527 Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:37:39.927545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:37:39.929180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b5638f78ab9440479a209d0023e6d0bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5638f78ab9440479a209d0023e6d0bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5638f78ab9440479a209d0023e6d0bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b5638f78ab9440479a209d0023e6d0bd"}]}] Aug 19 16:37:39.929180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1328462527 Aug 19 16:37:39.929180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: b5638f78ab9440479a209d0023e6d0bd Aug 19 16:37:39.929180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1328462527 Aug 19 16:37:39.929180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-ServerRescueNegativeTestJSON-1328462527-project Aug 19 16:37:39.929180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:37:39.929180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:37:39.929180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: 7936bf23a031418b8ce304aa3bbcf8a2 Aug 19 16:37:39.929180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1328462527-project Aug 19 16:37:39.929180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:37:39.929180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance 9ed4c246-7322-49b8-9bf7-2efaacc54b0b could not be found. Aug 19 16:37:39.929180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': '9ed4c246-7322-49b8-9bf7-2efaacc54b0b'} Aug 19 16:37:39.930255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:37:39.930255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:37:39.930255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:37:39.930255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:37:39.930255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:37:39.930255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:37:39.930255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:37:39.930255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:37:39.930255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:37:39.930255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:37:39.930255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ed4c246-7322-49b8-9bf7-2efaacc54b0b could not be found. Aug 19 16:37:39.930255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:37:39.930255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:37:39.930255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:37:39.930255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:37:39.930255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:37:39.930255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:37:39.930255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:37:39.930255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:37:39.930255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:37:39.931805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:37:39.931805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:37:39.931805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:37:39.931805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:37:39.931805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:37:39.931805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:37:39.931805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:37:39.931805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ed4c246-7322-49b8-9bf7-2efaacc54b0b could not be found. Aug 19 16:37:39.931805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:37:39.931805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:37:39.931805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:37:39.931805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:37:39.931805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:37:39.931805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:37:39.931805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:37:39.931805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:37:39.931805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ed4c246-7322-49b8-9bf7-2efaacc54b0b could not be found. Aug 19 16:37:39.931805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:37:39.933231 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8b84adb6-2d01-41ba-8d99-956c0afee09a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Returning 404 to user: Instance 9ed4c246-7322-49b8-9bf7-2efaacc54b0b could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:37:39.933231 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8b84adb6-2d01-41ba-8d99-956c0afee09a tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b" status: 404 len: 111 microversion: 2.1 time: 0.031203 Aug 19 16:37:39.933231 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 436/875] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:39 2022] GET /compute/v2.1/servers/9ed4c246-7322-49b8-9bf7-2efaacc54b0b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:37:39.939345 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-961a6471-999e-4228-bfcc-8c1f6dc71b32 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '.version_select at 0x7fb01def9700>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:39.959655 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-961a6471-999e-4228-bfcc-8c1f6dc71b32 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-229491225" status: 202 len: 0 microversion: 2.1 time: 0.025020 Aug 19 16:37:39.963624 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 440/876] 10.222.0.55 () {58 vars in 1218 bytes} [Fri Aug 19 16:37:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-229491225 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:37:40.537549 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-7411b0f0-c593-4aaa-9616-8f4e2076cc30 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:40.538171 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-7411b0f0-c593-4aaa-9616-8f4e2076cc30 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:40.544331 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7411b0f0-c593-4aaa-9616-8f4e2076cc30 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:40.544874 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7411b0f0-c593-4aaa-9616-8f4e2076cc30 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:40.545348 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7411b0f0-c593-4aaa-9616-8f4e2076cc30 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:40.546036 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7411b0f0-c593-4aaa-9616-8f4e2076cc30 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:40.547124 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7411b0f0-c593-4aaa-9616-8f4e2076cc30 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:40.547682 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7411b0f0-c593-4aaa-9616-8f4e2076cc30 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:40.861064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7411b0f0-c593-4aaa-9616-8f4e2076cc30 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:40.868982 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-7411b0f0-c593-4aaa-9616-8f4e2076cc30 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1266 microversion: 2.1 time: 0.335565 Aug 19 16:37:40.880944 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 437/877] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:40 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1266 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:41.892559 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b1c65355-5bd4-4598-abaa-f8632d0915d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:41.893324 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-b1c65355-5bd4-4598-abaa-f8632d0915d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:41.899486 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b1c65355-5bd4-4598-abaa-f8632d0915d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:41.899976 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b1c65355-5bd4-4598-abaa-f8632d0915d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:41.900442 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b1c65355-5bd4-4598-abaa-f8632d0915d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:41.901185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b1c65355-5bd4-4598-abaa-f8632d0915d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:41.901643 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b1c65355-5bd4-4598-abaa-f8632d0915d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:41.902070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b1c65355-5bd4-4598-abaa-f8632d0915d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:42.032150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b1c65355-5bd4-4598-abaa-f8632d0915d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:42.039884 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b1c65355-5bd4-4598-abaa-f8632d0915d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1266 microversion: 2.1 time: 0.151959 Aug 19 16:37:42.040439 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 441/878] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:41 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:43.060483 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-7a5e9ea4-b615-4efd-a34a-590d7e348b54 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:43.061116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-7a5e9ea4-b615-4efd-a34a-590d7e348b54 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:43.068219 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7a5e9ea4-b615-4efd-a34a-590d7e348b54 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:43.068699 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7a5e9ea4-b615-4efd-a34a-590d7e348b54 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:43.069168 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7a5e9ea4-b615-4efd-a34a-590d7e348b54 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:43.069850 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7a5e9ea4-b615-4efd-a34a-590d7e348b54 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:43.070300 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7a5e9ea4-b615-4efd-a34a-590d7e348b54 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:43.070723 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7a5e9ea4-b615-4efd-a34a-590d7e348b54 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:43.199024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7a5e9ea4-b615-4efd-a34a-590d7e348b54 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:43.206694 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-7a5e9ea4-b615-4efd-a34a-590d7e348b54 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1266 microversion: 2.1 time: 0.150071 Aug 19 16:37:43.207254 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 438/879] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:43 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:43.303663 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-28a14cec-ff01-4aeb-90b1-cee96e763450 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:43.304161 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-28a14cec-ff01-4aeb-90b1-cee96e763450 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:43.310617 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-28a14cec-ff01-4aeb-90b1-cee96e763450 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:43.311031 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-28a14cec-ff01-4aeb-90b1-cee96e763450 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:43.311465 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-28a14cec-ff01-4aeb-90b1-cee96e763450 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:43.312253 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-28a14cec-ff01-4aeb-90b1-cee96e763450 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:43.312706 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-28a14cec-ff01-4aeb-90b1-cee96e763450 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:43.313158 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-28a14cec-ff01-4aeb-90b1-cee96e763450 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:43.338348 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-28a14cec-ff01-4aeb-90b1-cee96e763450 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Going to try to terminate instance {{(pid=127284) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:37:43.411637 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-28a14cec-ff01-4aeb-90b1-cee96e763450 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "DELETE /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 204 len: 0 microversion: 2.1 time: 0.111508 Aug 19 16:37:43.412213 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 442/880] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:37:43 2022] DELETE /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:37:43.420880 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-dec5a822-988f-4b17-9f78-9ec666cc08df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:43.422177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-dec5a822-988f-4b17-9f78-9ec666cc08df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:43.428133 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dec5a822-988f-4b17-9f78-9ec666cc08df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:43.428613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dec5a822-988f-4b17-9f78-9ec666cc08df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:43.429082 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dec5a822-988f-4b17-9f78-9ec666cc08df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:43.429769 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dec5a822-988f-4b17-9f78-9ec666cc08df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:43.430220 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dec5a822-988f-4b17-9f78-9ec666cc08df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:43.430648 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dec5a822-988f-4b17-9f78-9ec666cc08df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:43.535936 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=2 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:43.555608 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=6 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:43.562463 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-dec5a822-988f-4b17-9f78-9ec666cc08df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:43.569959 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-dec5a822-988f-4b17-9f78-9ec666cc08df tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1506 microversion: 2.1 time: 0.153373 Aug 19 16:37:43.570534 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 439/881] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:43 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:44.235709 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-dd35555d-13ce-4020-8453-f5967bd665f2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:44.236401 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-dd35555d-13ce-4020-8453-f5967bd665f2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:44.238330 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=2 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:44.243888 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd35555d-13ce-4020-8453-f5967bd665f2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:44.244378 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd35555d-13ce-4020-8453-f5967bd665f2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:44.244850 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd35555d-13ce-4020-8453-f5967bd665f2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:44.245532 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd35555d-13ce-4020-8453-f5967bd665f2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:44.245989 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd35555d-13ce-4020-8453-f5967bd665f2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:44.246414 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd35555d-13ce-4020-8453-f5967bd665f2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:44.379222 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-dd35555d-13ce-4020-8453-f5967bd665f2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:44.386868 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-dd35555d-13ce-4020-8453-f5967bd665f2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1266 microversion: 2.1 time: 0.155663 Aug 19 16:37:44.387438 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 443/882] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:44 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:44.591568 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-73bf85f8-75dd-4f9e-a1f8-20eeba34a622 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:44.592200 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-73bf85f8-75dd-4f9e-a1f8-20eeba34a622 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:44.598782 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-73bf85f8-75dd-4f9e-a1f8-20eeba34a622 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:44.599267 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-73bf85f8-75dd-4f9e-a1f8-20eeba34a622 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:44.599697 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-73bf85f8-75dd-4f9e-a1f8-20eeba34a622 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:44.600369 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-73bf85f8-75dd-4f9e-a1f8-20eeba34a622 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:44.600841 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-73bf85f8-75dd-4f9e-a1f8-20eeba34a622 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:44.601262 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-73bf85f8-75dd-4f9e-a1f8-20eeba34a622 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:44.728394 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-73bf85f8-75dd-4f9e-a1f8-20eeba34a622 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:44.736520 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-73bf85f8-75dd-4f9e-a1f8-20eeba34a622 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1506 microversion: 2.1 time: 0.148863 Aug 19 16:37:44.737112 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 440/883] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:44 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:45.408011 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-96932495-c02a-431f-86d0-e106ce1889bb tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:45.408597 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-96932495-c02a-431f-86d0-e106ce1889bb tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:45.415088 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-96932495-c02a-431f-86d0-e106ce1889bb tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:45.415557 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-96932495-c02a-431f-86d0-e106ce1889bb tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:45.415984 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-96932495-c02a-431f-86d0-e106ce1889bb tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:45.416658 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-96932495-c02a-431f-86d0-e106ce1889bb tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:45.417131 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-96932495-c02a-431f-86d0-e106ce1889bb tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:45.417547 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-96932495-c02a-431f-86d0-e106ce1889bb tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:45.546482 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-96932495-c02a-431f-86d0-e106ce1889bb tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:45.554006 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-96932495-c02a-431f-86d0-e106ce1889bb tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1266 microversion: 2.1 time: 0.150646 Aug 19 16:37:45.554561 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 444/884] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:45 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:45.756467 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-bdfcf64f-41a6-4639-bcad-44a7f15ab1db tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:45.757113 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-bdfcf64f-41a6-4639-bcad-44a7f15ab1db tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:45.763409 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bdfcf64f-41a6-4639-bcad-44a7f15ab1db tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:45.763882 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bdfcf64f-41a6-4639-bcad-44a7f15ab1db tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:45.764310 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bdfcf64f-41a6-4639-bcad-44a7f15ab1db tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:45.765020 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bdfcf64f-41a6-4639-bcad-44a7f15ab1db tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:45.765468 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bdfcf64f-41a6-4639-bcad-44a7f15ab1db tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:45.765888 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bdfcf64f-41a6-4639-bcad-44a7f15ab1db tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:45.894983 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-bdfcf64f-41a6-4639-bcad-44a7f15ab1db tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:45.898470 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:45.903618 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-bdfcf64f-41a6-4639-bcad-44a7f15ab1db tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1506 microversion: 2.1 time: 0.150957 Aug 19 16:37:45.904178 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 441/885] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:45 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:46.575143 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8a3a3410-f9c2-49b6-bffc-648b2ba4fb0a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:46.575782 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8a3a3410-f9c2-49b6-bffc-648b2ba4fb0a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:46.582662 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8a3a3410-f9c2-49b6-bffc-648b2ba4fb0a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:46.583140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8a3a3410-f9c2-49b6-bffc-648b2ba4fb0a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:46.583572 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8a3a3410-f9c2-49b6-bffc-648b2ba4fb0a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:46.584254 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8a3a3410-f9c2-49b6-bffc-648b2ba4fb0a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:46.584708 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8a3a3410-f9c2-49b6-bffc-648b2ba4fb0a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:46.585158 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8a3a3410-f9c2-49b6-bffc-648b2ba4fb0a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:46.720146 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8a3a3410-f9c2-49b6-bffc-648b2ba4fb0a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:46.727757 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8a3a3410-f9c2-49b6-bffc-648b2ba4fb0a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1266 microversion: 2.1 time: 0.156722 Aug 19 16:37:46.728308 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 445/886] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:46 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:46.925346 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-25e39773-024b-4980-a49e-d09009f820e9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:46.926183 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-25e39773-024b-4980-a49e-d09009f820e9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:46.933170 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-25e39773-024b-4980-a49e-d09009f820e9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:46.933644 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-25e39773-024b-4980-a49e-d09009f820e9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:46.934072 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-25e39773-024b-4980-a49e-d09009f820e9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:46.934752 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-25e39773-024b-4980-a49e-d09009f820e9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:46.935225 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-25e39773-024b-4980-a49e-d09009f820e9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:46.935647 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-25e39773-024b-4980-a49e-d09009f820e9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:47.067446 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-25e39773-024b-4980-a49e-d09009f820e9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:47.075271 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-25e39773-024b-4980-a49e-d09009f820e9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1506 microversion: 2.1 time: 0.154434 Aug 19 16:37:47.075818 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 442/887] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:46 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:47.747532 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-da03b3b3-a66c-4906-aee4-35a4a4a03e54 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:47.748140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-da03b3b3-a66c-4906-aee4-35a4a4a03e54 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:47.760431 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-ab814014-e53b-434c-a6c3-3ca905cced81 req-6e1f1c65-9c73-4343-8e36-bce2e55b2f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "665dc524-b20c-4aa5-8861-13ad96d28939", "name": "network-vif-deleted", "tag": "bb51172e-dc0e-4fcc-b012-110d88786f10"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:37:47.764235 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-da03b3b3-a66c-4906-aee4-35a4a4a03e54 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:47.765460 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-da03b3b3-a66c-4906-aee4-35a4a4a03e54 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:47.766123 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-da03b3b3-a66c-4906-aee4-35a4a4a03e54 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:47.767073 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-da03b3b3-a66c-4906-aee4-35a4a4a03e54 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:47.767800 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-da03b3b3-a66c-4906-aee4-35a4a4a03e54 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:47.768460 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-da03b3b3-a66c-4906-aee4-35a4a4a03e54 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:47.771340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-ab814014-e53b-434c-a6c3-3ca905cced81 req-6e1f1c65-9c73-4343-8e36-bce2e55b2f65 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:47.771814 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-ab814014-e53b-434c-a6c3-3ca905cced81 req-6e1f1c65-9c73-4343-8e36-bce2e55b2f65 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:47.772238 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-ab814014-e53b-434c-a6c3-3ca905cced81 req-6e1f1c65-9c73-4343-8e36-bce2e55b2f65 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:47.784297 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-ab814014-e53b-434c-a6c3-3ca905cced81 req-6e1f1c65-9c73-4343-8e36-bce2e55b2f65 service nova] Creating event network-vif-deleted:bb51172e-dc0e-4fcc-b012-110d88786f10 for instance 665dc524-b20c-4aa5-8861-13ad96d28939 on hv-cinder-83124 Aug 19 16:37:47.789099 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-ab814014-e53b-434c-a6c3-3ca905cced81 req-6e1f1c65-9c73-4343-8e36-bce2e55b2f65 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032712 Aug 19 16:37:47.790008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 443/888] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:37:47.913789 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-da03b3b3-a66c-4906-aee4-35a4a4a03e54 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:47.921973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-da03b3b3-a66c-4906-aee4-35a4a4a03e54 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1266 microversion: 2.1 time: 0.178437 Aug 19 16:37:47.922526 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 446/889] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:47 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:48.097527 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1dabd8f2-3745-46c1-bf52-7db38693c079 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:48.098255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-1dabd8f2-3745-46c1-bf52-7db38693c079 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:48.104612 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1dabd8f2-3745-46c1-bf52-7db38693c079 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:48.105129 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1dabd8f2-3745-46c1-bf52-7db38693c079 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:48.105566 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1dabd8f2-3745-46c1-bf52-7db38693c079 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:48.106265 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1dabd8f2-3745-46c1-bf52-7db38693c079 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:48.106722 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1dabd8f2-3745-46c1-bf52-7db38693c079 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:48.107150 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1dabd8f2-3745-46c1-bf52-7db38693c079 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:48.141057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1dabd8f2-3745-46c1-bf52-7db38693c079 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:48.141547 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1dabd8f2-3745-46c1-bf52-7db38693c079 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:48.141982 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1dabd8f2-3745-46c1-bf52-7db38693c079 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:48.142433 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.objects.instance [None req-1dabd8f2-3745-46c1-bf52-7db38693c079 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lazy-loading 'fault' on Instance uuid 665dc524-b20c-4aa5-8861-13ad96d28939 {{(pid=127285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:37:48.189640 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1dabd8f2-3745-46c1-bf52-7db38693c079 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:48.197573 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-1dabd8f2-3745-46c1-bf52-7db38693c079 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 200 len: 1311 microversion: 2.1 time: 0.104816 Aug 19 16:37:48.198164 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 444/890] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:48 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:48.942528 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-50c83417-f95a-4bd3-9db8-39be61ee178a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:48.943136 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-50c83417-f95a-4bd3-9db8-39be61ee178a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:48.950012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-50c83417-f95a-4bd3-9db8-39be61ee178a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:48.950491 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-50c83417-f95a-4bd3-9db8-39be61ee178a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:48.950931 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-50c83417-f95a-4bd3-9db8-39be61ee178a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:48.951613 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-50c83417-f95a-4bd3-9db8-39be61ee178a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:48.952848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-50c83417-f95a-4bd3-9db8-39be61ee178a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:48.953286 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-50c83417-f95a-4bd3-9db8-39be61ee178a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:49.082695 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-50c83417-f95a-4bd3-9db8-39be61ee178a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:49.090517 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-50c83417-f95a-4bd3-9db8-39be61ee178a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1266 microversion: 2.1 time: 0.151817 Aug 19 16:37:49.091086 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 447/891] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:48 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:49.218607 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-550464f1-2a6f-4d4a-b712-925f2b85f745 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:49.219144 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-550464f1-2a6f-4d4a-b712-925f2b85f745 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 665dc524-b20c-4aa5-8861-13ad96d28939] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:49.225422 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-550464f1-2a6f-4d4a-b712-925f2b85f745 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:49.225904 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-550464f1-2a6f-4d4a-b712-925f2b85f745 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:49.226344 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-550464f1-2a6f-4d4a-b712-925f2b85f745 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:49.227022 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-550464f1-2a6f-4d4a-b712-925f2b85f745 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:49.227477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-550464f1-2a6f-4d4a-b712-925f2b85f745 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:49.227897 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-550464f1-2a6f-4d4a-b712-925f2b85f745 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:49.241915 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-550464f1-2a6f-4d4a-b712-925f2b85f745 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] HTTP exception thrown: Instance 665dc524-b20c-4aa5-8861-13ad96d28939 could not be found. Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-550464f1-2a6f-4d4a-b712-925f2b85f745 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Request method failure captured: Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 HTTP/1.1 Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7sC2YMsastFwF5KHrblHGiieD2S6sdzYymMS54J0x8Vt4lT84xG-4lz_ihMmAVoylGBgEjsioBmjrEY0M57P2KMvM72KxZwA4DIrU64AxkuAJ1z0DkabuEtOI2EukBYULCeMuCjhjcFFPoj2rUEBN2R8sCo70cp1AnirNniwWFQth0 Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: b5638f78ab9440479a209d0023e6d0bd Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1328462527 Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:37:49.243578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:37:49.245015 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b5638f78ab9440479a209d0023e6d0bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5638f78ab9440479a209d0023e6d0bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5638f78ab9440479a209d0023e6d0bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b5638f78ab9440479a209d0023e6d0bd"}]}] Aug 19 16:37:49.245015 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1328462527 Aug 19 16:37:49.245015 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: b5638f78ab9440479a209d0023e6d0bd Aug 19 16:37:49.245015 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1328462527 Aug 19 16:37:49.245015 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-ServerRescueNegativeTestJSON-1328462527-project Aug 19 16:37:49.245015 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:37:49.245015 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:37:49.245015 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: 7936bf23a031418b8ce304aa3bbcf8a2 Aug 19 16:37:49.245015 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1328462527-project Aug 19 16:37:49.245015 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:37:49.245015 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance 665dc524-b20c-4aa5-8861-13ad96d28939 could not be found. Aug 19 16:37:49.245015 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': '665dc524-b20c-4aa5-8861-13ad96d28939'} Aug 19 16:37:49.245893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:37:49.245893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:37:49.245893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:37:49.245893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:37:49.245893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:37:49.245893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:37:49.245893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:37:49.245893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:37:49.245893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:37:49.245893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:37:49.245893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 665dc524-b20c-4aa5-8861-13ad96d28939 could not be found. Aug 19 16:37:49.245893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:37:49.245893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:37:49.245893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:37:49.245893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:37:49.245893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:37:49.245893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:37:49.245893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:37:49.245893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:37:49.245893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:37:49.247140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:37:49.247140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:37:49.247140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:37:49.247140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:37:49.247140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:37:49.247140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:37:49.247140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:37:49.247140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 665dc524-b20c-4aa5-8861-13ad96d28939 could not be found. Aug 19 16:37:49.247140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:37:49.247140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:37:49.247140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:37:49.247140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:37:49.247140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:37:49.247140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:37:49.247140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:37:49.247140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:37:49.247140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 665dc524-b20c-4aa5-8861-13ad96d28939 could not be found. Aug 19 16:37:49.247140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:37:49.248273 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-550464f1-2a6f-4d4a-b712-925f2b85f745 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Returning 404 to user: Instance 665dc524-b20c-4aa5-8861-13ad96d28939 could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:37:49.248273 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-550464f1-2a6f-4d4a-b712-925f2b85f745 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939" status: 404 len: 111 microversion: 2.1 time: 0.030416 Aug 19 16:37:49.248273 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 445/892] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:49 2022] GET /compute/v2.1/servers/665dc524-b20c-4aa5-8861-13ad96d28939 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:37:49.254650 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a72a0bd5-2f80-45b9-b475-07f8e2dcea41 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:49.255144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a72a0bd5-2f80-45b9-b475-07f8e2dcea41 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:49.261205 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a72a0bd5-2f80-45b9-b475-07f8e2dcea41 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:49.261689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a72a0bd5-2f80-45b9-b475-07f8e2dcea41 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:49.262123 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a72a0bd5-2f80-45b9-b475-07f8e2dcea41 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:49.262815 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a72a0bd5-2f80-45b9-b475-07f8e2dcea41 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:49.263301 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a72a0bd5-2f80-45b9-b475-07f8e2dcea41 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:49.263725 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a72a0bd5-2f80-45b9-b475-07f8e2dcea41 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:49.288972 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a72a0bd5-2f80-45b9-b475-07f8e2dcea41 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Going to try to terminate instance {{(pid=127284) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:37:49.365223 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a72a0bd5-2f80-45b9-b475-07f8e2dcea41 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "DELETE /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 204 len: 0 microversion: 2.1 time: 0.114243 Aug 19 16:37:49.365800 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 448/893] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:37:49 2022] DELETE /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 19 16:37:49.375720 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0f4781f9-00f7-4a74-a864-b7b2b5bbd656 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:49.376326 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-0f4781f9-00f7-4a74-a864-b7b2b5bbd656 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:49.382556 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0f4781f9-00f7-4a74-a864-b7b2b5bbd656 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:49.383874 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0f4781f9-00f7-4a74-a864-b7b2b5bbd656 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:49.384347 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0f4781f9-00f7-4a74-a864-b7b2b5bbd656 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:49.385165 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0f4781f9-00f7-4a74-a864-b7b2b5bbd656 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:49.385616 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0f4781f9-00f7-4a74-a864-b7b2b5bbd656 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:49.386041 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0f4781f9-00f7-4a74-a864-b7b2b5bbd656 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:49.514872 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-0f4781f9-00f7-4a74-a864-b7b2b5bbd656 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:49.522391 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-0f4781f9-00f7-4a74-a864-b7b2b5bbd656 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.152210 Aug 19 16:37:49.522944 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 446/894] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:49 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:37:50.111986 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-754cc5bd-6979-4450-b690-2b603ae9d749 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:50.112684 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-754cc5bd-6979-4450-b690-2b603ae9d749 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:50.119068 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-754cc5bd-6979-4450-b690-2b603ae9d749 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:50.119546 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-754cc5bd-6979-4450-b690-2b603ae9d749 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:50.119983 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-754cc5bd-6979-4450-b690-2b603ae9d749 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:50.120668 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-754cc5bd-6979-4450-b690-2b603ae9d749 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:50.121142 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-754cc5bd-6979-4450-b690-2b603ae9d749 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:50.121562 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-754cc5bd-6979-4450-b690-2b603ae9d749 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:50.253978 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-754cc5bd-6979-4450-b690-2b603ae9d749 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:50.261657 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-754cc5bd-6979-4450-b690-2b603ae9d749 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1266 microversion: 2.1 time: 0.153877 Aug 19 16:37:50.262213 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 449/895] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:50 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:50.528539 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-be445c2a-7c2c-44ba-ad20-3ee4215aa8fb req-19c20878-96c3-40cc-a1d5-8ffbb819635e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f", "name": "network-vif-plugged", "status": "completed", "tag": "494a4e31-f22f-4879-99a8-4f1e34a92a8e"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:37:50.539027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-be445c2a-7c2c-44ba-ad20-3ee4215aa8fb req-19c20878-96c3-40cc-a1d5-8ffbb819635e service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:50.539587 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-be445c2a-7c2c-44ba-ad20-3ee4215aa8fb req-19c20878-96c3-40cc-a1d5-8ffbb819635e service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:50.540084 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-be445c2a-7c2c-44ba-ad20-3ee4215aa8fb req-19c20878-96c3-40cc-a1d5-8ffbb819635e service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:50.543077 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b172a958-ce42-4870-85f2-17078f854f5c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:50.543686 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-b172a958-ce42-4870-85f2-17078f854f5c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:50.550102 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b172a958-ce42-4870-85f2-17078f854f5c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:50.550812 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b172a958-ce42-4870-85f2-17078f854f5c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:50.551529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b172a958-ce42-4870-85f2-17078f854f5c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:50.552310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b172a958-ce42-4870-85f2-17078f854f5c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:50.552639 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-be445c2a-7c2c-44ba-ad20-3ee4215aa8fb req-19c20878-96c3-40cc-a1d5-8ffbb819635e service nova] Creating event network-vif-plugged:494a4e31-f22f-4879-99a8-4f1e34a92a8e for instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f on hv-cinder-83124 Aug 19 16:37:50.552921 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b172a958-ce42-4870-85f2-17078f854f5c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:50.553421 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b172a958-ce42-4870-85f2-17078f854f5c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:50.557816 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-be445c2a-7c2c-44ba-ad20-3ee4215aa8fb req-19c20878-96c3-40cc-a1d5-8ffbb819635e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090337 Aug 19 16:37:50.560138 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 447/896] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:37:50.682207 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b172a958-ce42-4870-85f2-17078f854f5c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:50.690006 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b172a958-ce42-4870-85f2-17078f854f5c tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.150694 Aug 19 16:37:50.690567 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 450/897] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:50 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:37:51.283035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-bb952f71-afdc-4df9-9799-480821973ac0 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:51.283743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-bb952f71-afdc-4df9-9799-480821973ac0 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:51.289874 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bb952f71-afdc-4df9-9799-480821973ac0 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:51.290354 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bb952f71-afdc-4df9-9799-480821973ac0 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:51.290792 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bb952f71-afdc-4df9-9799-480821973ac0 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:51.291479 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bb952f71-afdc-4df9-9799-480821973ac0 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:51.291965 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bb952f71-afdc-4df9-9799-480821973ac0 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:51.292395 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bb952f71-afdc-4df9-9799-480821973ac0 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:51.425399 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-bb952f71-afdc-4df9-9799-480821973ac0 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:51.433046 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-bb952f71-afdc-4df9-9799-480821973ac0 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1266 microversion: 2.1 time: 0.154246 Aug 19 16:37:51.433612 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 448/898] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:51 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:51.711254 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-85228038-bc6a-48f1-aed8-51ff7d850c53 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:51.711868 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-85228038-bc6a-48f1-aed8-51ff7d850c53 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:51.718495 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-85228038-bc6a-48f1-aed8-51ff7d850c53 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:51.718975 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-85228038-bc6a-48f1-aed8-51ff7d850c53 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:51.719409 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-85228038-bc6a-48f1-aed8-51ff7d850c53 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:51.720093 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-85228038-bc6a-48f1-aed8-51ff7d850c53 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:51.720543 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-85228038-bc6a-48f1-aed8-51ff7d850c53 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:51.720996 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-85228038-bc6a-48f1-aed8-51ff7d850c53 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:51.850897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-85228038-bc6a-48f1-aed8-51ff7d850c53 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:51.859088 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-85228038-bc6a-48f1-aed8-51ff7d850c53 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.151673 Aug 19 16:37:51.859648 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 451/899] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:51 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:52.054954 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-821392f9-97a3-4da8-b01f-7062b373ae50 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:52.055448 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-821392f9-97a3-4da8-b01f-7062b373ae50 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:52.061407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-821392f9-97a3-4da8-b01f-7062b373ae50 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:52.061882 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-821392f9-97a3-4da8-b01f-7062b373ae50 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:52.062311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-821392f9-97a3-4da8-b01f-7062b373ae50 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:52.062987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-821392f9-97a3-4da8-b01f-7062b373ae50 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:52.063431 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-821392f9-97a3-4da8-b01f-7062b373ae50 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:52.063847 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-821392f9-97a3-4da8-b01f-7062b373ae50 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:52.086051 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-821392f9-97a3-4da8-b01f-7062b373ae50 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/ips" status: 200 len: 150 microversion: 2.1 time: 0.131995 Aug 19 16:37:52.086582 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 449/900] 10.222.0.55 () {58 vars in 1248 bytes} [Fri Aug 19 16:37:51 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/ips => generated 150 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:37:52.454056 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c22df52d-f27c-4fd1-9062-c0bd4e536709 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:52.454684 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-c22df52d-f27c-4fd1-9062-c0bd4e536709 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:52.460487 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c22df52d-f27c-4fd1-9062-c0bd4e536709 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:52.460997 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c22df52d-f27c-4fd1-9062-c0bd4e536709 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:52.461433 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c22df52d-f27c-4fd1-9062-c0bd4e536709 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:52.462109 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c22df52d-f27c-4fd1-9062-c0bd4e536709 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:52.462605 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c22df52d-f27c-4fd1-9062-c0bd4e536709 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:52.463136 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c22df52d-f27c-4fd1-9062-c0bd4e536709 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:52.467144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:37:52.597616 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c22df52d-f27c-4fd1-9062-c0bd4e536709 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:52.605314 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c22df52d-f27c-4fd1-9062-c0bd4e536709 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1266 microversion: 2.1 time: 0.155669 Aug 19 16:37:52.605883 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 452/901] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:52 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:52.880430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d7f1694d-849e-4c2e-8c19-8ff96d46f54e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:52.881197 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d7f1694d-849e-4c2e-8c19-8ff96d46f54e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:52.887014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d7f1694d-849e-4c2e-8c19-8ff96d46f54e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:52.887499 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d7f1694d-849e-4c2e-8c19-8ff96d46f54e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:52.887930 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d7f1694d-849e-4c2e-8c19-8ff96d46f54e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:52.888623 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d7f1694d-849e-4c2e-8c19-8ff96d46f54e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:52.889903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d7f1694d-849e-4c2e-8c19-8ff96d46f54e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:52.890340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d7f1694d-849e-4c2e-8c19-8ff96d46f54e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:53.114222 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d7f1694d-849e-4c2e-8c19-8ff96d46f54e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:53.121855 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d7f1694d-849e-4c2e-8c19-8ff96d46f54e tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1521 microversion: 2.1 time: 0.245499 Aug 19 16:37:53.122408 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 450/902] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:52 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:53.336639 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-43da74ce-1d5e-4f3b-98d1-d614d7dc6fa8 req-2b1b4b60-52dc-4195-b443-53aa4113908d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fc9558-1f91-4cbd-b5f1-9342dc7d6148", "name": "network-vif-deleted", "tag": "1a92f5a0-de60-40bf-b6d4-a7c9883868ba"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:37:53.346825 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-43da74ce-1d5e-4f3b-98d1-d614d7dc6fa8 req-2b1b4b60-52dc-4195-b443-53aa4113908d service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:53.347295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-43da74ce-1d5e-4f3b-98d1-d614d7dc6fa8 req-2b1b4b60-52dc-4195-b443-53aa4113908d service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:53.347714 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-43da74ce-1d5e-4f3b-98d1-d614d7dc6fa8 req-2b1b4b60-52dc-4195-b443-53aa4113908d service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:53.358567 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-43da74ce-1d5e-4f3b-98d1-d614d7dc6fa8 req-2b1b4b60-52dc-4195-b443-53aa4113908d service nova] Creating event network-vif-deleted:1a92f5a0-de60-40bf-b6d4-a7c9883868ba for instance 73fc9558-1f91-4cbd-b5f1-9342dc7d6148 on hv-cinder-83124 Aug 19 16:37:53.363424 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-43da74ce-1d5e-4f3b-98d1-d614d7dc6fa8 req-2b1b4b60-52dc-4195-b443-53aa4113908d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030438 Aug 19 16:37:53.364190 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 453/903] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:37:53.415217 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-52c991ed-940c-4dbb-a832-5eca39dd2f1b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3291477c-fa97-40f9-b4a7-84e92670521b"}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:37:53.417727 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-52c991ed-940c-4dbb-a832-5eca39dd2f1b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:53.423651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-52c991ed-940c-4dbb-a832-5eca39dd2f1b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:53.424130 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-52c991ed-940c-4dbb-a832-5eca39dd2f1b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:53.424562 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-52c991ed-940c-4dbb-a832-5eca39dd2f1b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:53.425275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-52c991ed-940c-4dbb-a832-5eca39dd2f1b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:53.425727 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-52c991ed-940c-4dbb-a832-5eca39dd2f1b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:53.426148 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-52c991ed-940c-4dbb-a832-5eca39dd2f1b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:53.627029 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e9541db6-ba40-4d99-b4bf-f1b6a7fa4225 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:53.627738 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-e9541db6-ba40-4d99-b4bf-f1b6a7fa4225 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:53.634028 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e9541db6-ba40-4d99-b4bf-f1b6a7fa4225 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:53.634553 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e9541db6-ba40-4d99-b4bf-f1b6a7fa4225 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:53.634994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e9541db6-ba40-4d99-b4bf-f1b6a7fa4225 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:53.635698 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e9541db6-ba40-4d99-b4bf-f1b6a7fa4225 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:53.636160 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e9541db6-ba40-4d99-b4bf-f1b6a7fa4225 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:53.636599 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e9541db6-ba40-4d99-b4bf-f1b6a7fa4225 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:53.779176 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e9541db6-ba40-4d99-b4bf-f1b6a7fa4225 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:53.787158 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e9541db6-ba40-4d99-b4bf-f1b6a7fa4225 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1266 microversion: 2.1 time: 0.165390 Aug 19 16:37:53.787710 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 454/904] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:53 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:37:54.142997 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-53fb97f2-1521-489c-945e-b2fdc708cb7b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:54.143673 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-53fb97f2-1521-489c-945e-b2fdc708cb7b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:54.149888 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53fb97f2-1521-489c-945e-b2fdc708cb7b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:54.150848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53fb97f2-1521-489c-945e-b2fdc708cb7b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:54.151326 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53fb97f2-1521-489c-945e-b2fdc708cb7b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:54.152012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53fb97f2-1521-489c-945e-b2fdc708cb7b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:54.152469 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53fb97f2-1521-489c-945e-b2fdc708cb7b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:54.152940 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53fb97f2-1521-489c-945e-b2fdc708cb7b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:54.175189 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-52c991ed-940c-4dbb-a832-5eca39dd2f1b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "POST /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.763724 Aug 19 16:37:54.179448 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 451/905] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Aug 19 16:37:53 2022] POST /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-volume_attachments => generated 194 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:37:54.189756 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53fb97f2-1521-489c-945e-b2fdc708cb7b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:54.190245 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53fb97f2-1521-489c-945e-b2fdc708cb7b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:54.190683 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-53fb97f2-1521-489c-945e-b2fdc708cb7b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:54.191136 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.objects.instance [None req-53fb97f2-1521-489c-945e-b2fdc708cb7b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lazy-loading 'fault' on Instance uuid 73fc9558-1f91-4cbd-b5f1-9342dc7d6148 {{(pid=127284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:37:54.239289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-53fb97f2-1521-489c-945e-b2fdc708cb7b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:54.247066 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-53fb97f2-1521-489c-945e-b2fdc708cb7b tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1311 microversion: 2.1 time: 0.108166 Aug 19 16:37:54.247670 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 455/906] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:54 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:54.809293 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-bf31267b-0ca0-4971-811a-2da8319663e1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:54.809994 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-bf31267b-0ca0-4971-811a-2da8319663e1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:54.816062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bf31267b-0ca0-4971-811a-2da8319663e1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:54.816542 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bf31267b-0ca0-4971-811a-2da8319663e1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:54.817012 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bf31267b-0ca0-4971-811a-2da8319663e1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:54.817698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bf31267b-0ca0-4971-811a-2da8319663e1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:54.818155 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bf31267b-0ca0-4971-811a-2da8319663e1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:54.818579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bf31267b-0ca0-4971-811a-2da8319663e1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:54.958580 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-bf31267b-0ca0-4971-811a-2da8319663e1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:54.966675 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-bf31267b-0ca0-4971-811a-2da8319663e1 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1266 microversion: 2.1 time: 0.162143 Aug 19 16:37:54.967425 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 452/907] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:54 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:55.268244 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-4f68aa83-18b9-4c43-9a6d-d8b7dd50c6a9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:55.268894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-4f68aa83-18b9-4c43-9a6d-d8b7dd50c6a9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:55.275368 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f68aa83-18b9-4c43-9a6d-d8b7dd50c6a9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:55.275860 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f68aa83-18b9-4c43-9a6d-d8b7dd50c6a9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:55.276304 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f68aa83-18b9-4c43-9a6d-d8b7dd50c6a9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:55.277026 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f68aa83-18b9-4c43-9a6d-d8b7dd50c6a9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:55.277488 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f68aa83-18b9-4c43-9a6d-d8b7dd50c6a9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:55.277917 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f68aa83-18b9-4c43-9a6d-d8b7dd50c6a9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:55.308896 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f68aa83-18b9-4c43-9a6d-d8b7dd50c6a9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:55.309378 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f68aa83-18b9-4c43-9a6d-d8b7dd50c6a9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:55.309809 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4f68aa83-18b9-4c43-9a6d-d8b7dd50c6a9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:55.310248 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.objects.instance [None req-4f68aa83-18b9-4c43-9a6d-d8b7dd50c6a9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lazy-loading 'fault' on Instance uuid 73fc9558-1f91-4cbd-b5f1-9342dc7d6148 {{(pid=127284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:37:55.351469 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-4f68aa83-18b9-4c43-9a6d-d8b7dd50c6a9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7936bf23a031418b8ce304aa3bbcf8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5638f78ab9440479a209d0023e6d0bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:55.360151 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-4f68aa83-18b9-4c43-9a6d-d8b7dd50c6a9 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 200 len: 1311 microversion: 2.1 time: 0.096559 Aug 19 16:37:55.360718 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 456/908] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:55 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:55.987681 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a8f3da59-421f-478f-9d6e-3a0602b21699 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:55.988294 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a8f3da59-421f-478f-9d6e-3a0602b21699 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:55.994645 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a8f3da59-421f-478f-9d6e-3a0602b21699 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:55.995129 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a8f3da59-421f-478f-9d6e-3a0602b21699 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:55.995563 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a8f3da59-421f-478f-9d6e-3a0602b21699 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:55.996256 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a8f3da59-421f-478f-9d6e-3a0602b21699 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:55.996714 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a8f3da59-421f-478f-9d6e-3a0602b21699 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:55.997172 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a8f3da59-421f-478f-9d6e-3a0602b21699 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:56.125514 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a8f3da59-421f-478f-9d6e-3a0602b21699 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:56.133386 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a8f3da59-421f-478f-9d6e-3a0602b21699 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1453 microversion: 2.1 time: 0.149543 Aug 19 16:37:56.134025 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 453/909] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:55 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:56.155378 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-77cb75b6-099a-46ae-96b6-bb42087b73ca tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:56.155986 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-77cb75b6-099a-46ae-96b6-bb42087b73ca tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:56.161858 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-77cb75b6-099a-46ae-96b6-bb42087b73ca tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:56.162601 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-77cb75b6-099a-46ae-96b6-bb42087b73ca tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:56.163038 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-77cb75b6-099a-46ae-96b6-bb42087b73ca tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:56.163725 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-77cb75b6-099a-46ae-96b6-bb42087b73ca tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:56.164170 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-77cb75b6-099a-46ae-96b6-bb42087b73ca tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:56.164593 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-77cb75b6-099a-46ae-96b6-bb42087b73ca tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:56.299231 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-77cb75b6-099a-46ae-96b6-bb42087b73ca tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:37:56.306909 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-77cb75b6-099a-46ae-96b6-bb42087b73ca tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1453 microversion: 2.1 time: 0.156209 Aug 19 16:37:56.307467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 457/910] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:56 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:37:56.381780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-40774ffc-a2db-4deb-a033-3655701b1ea1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:37:56.382398 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-40774ffc-a2db-4deb-a033-3655701b1ea1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] [instance: 73fc9558-1f91-4cbd-b5f1-9342dc7d6148] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:37:56.388240 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-40774ffc-a2db-4deb-a033-3655701b1ea1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:56.388726 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-40774ffc-a2db-4deb-a033-3655701b1ea1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:56.390032 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-40774ffc-a2db-4deb-a033-3655701b1ea1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:56.390841 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-40774ffc-a2db-4deb-a033-3655701b1ea1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:56.391302 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-40774ffc-a2db-4deb-a033-3655701b1ea1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:56.391735 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-40774ffc-a2db-4deb-a033-3655701b1ea1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:56.405802 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-40774ffc-a2db-4deb-a033-3655701b1ea1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] HTTP exception thrown: Instance 73fc9558-1f91-4cbd-b5f1-9342dc7d6148 could not be found. Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-40774ffc-a2db-4deb-a033-3655701b1ea1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Request method failure captured: Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 HTTP/1.1 Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7sC2YMsastFwF5KHrblHGiieD2S6sdzYymMS54J0x8Vt4lT84xG-4lz_ihMmAVoylGBgEjsioBmjrEY0M57P2KMvM72KxZwA4DIrU64AxkuAJ1z0DkabuEtOI2EukBYULCeMuCjhjcFFPoj2rUEBN2R8sCo70cp1AnirNniwWFQth0 Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: b5638f78ab9440479a209d0023e6d0bd Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1328462527 Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:37:56.407484 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:37:56.409000 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b5638f78ab9440479a209d0023e6d0bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5638f78ab9440479a209d0023e6d0bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5638f78ab9440479a209d0023e6d0bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b5638f78ab9440479a209d0023e6d0bd"}]}] Aug 19 16:37:56.409000 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1328462527 Aug 19 16:37:56.409000 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: b5638f78ab9440479a209d0023e6d0bd Aug 19 16:37:56.409000 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1328462527 Aug 19 16:37:56.409000 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-ServerRescueNegativeTestJSON-1328462527-project Aug 19 16:37:56.409000 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:37:56.409000 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:37:56.409000 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: 7936bf23a031418b8ce304aa3bbcf8a2 Aug 19 16:37:56.409000 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1328462527-project Aug 19 16:37:56.409000 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:37:56.409000 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance 73fc9558-1f91-4cbd-b5f1-9342dc7d6148 could not be found. Aug 19 16:37:56.409000 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': '73fc9558-1f91-4cbd-b5f1-9342dc7d6148'} Aug 19 16:37:56.409780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:37:56.409780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:37:56.409780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:37:56.409780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:37:56.409780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:37:56.409780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:37:56.409780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:37:56.409780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:37:56.409780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:37:56.409780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:37:56.409780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73fc9558-1f91-4cbd-b5f1-9342dc7d6148 could not be found. Aug 19 16:37:56.409780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:37:56.409780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:37:56.409780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:37:56.409780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:37:56.409780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:37:56.409780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:37:56.409780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:37:56.409780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:37:56.409780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:37:56.411008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:37:56.411008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:37:56.411008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:37:56.411008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:37:56.411008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:37:56.411008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:37:56.411008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:37:56.411008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73fc9558-1f91-4cbd-b5f1-9342dc7d6148 could not be found. Aug 19 16:37:56.411008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:37:56.411008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:37:56.411008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:37:56.411008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:37:56.411008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:37:56.411008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:37:56.411008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:37:56.411008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:37:56.411008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73fc9558-1f91-4cbd-b5f1-9342dc7d6148 could not be found. Aug 19 16:37:56.411008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:37:56.412188 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-40774ffc-a2db-4deb-a033-3655701b1ea1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] Returning 404 to user: Instance 73fc9558-1f91-4cbd-b5f1-9342dc7d6148 could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:37:56.412188 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-40774ffc-a2db-4deb-a033-3655701b1ea1 tempest-ServerRescueNegativeTestJSON-1328462527 tempest-ServerRescueNegativeTestJSON-1328462527-project] 10.222.0.55 "GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148" status: 404 len: 111 microversion: 2.1 time: 0.031059 Aug 19 16:37:56.412188 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 454/911] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:37:56 2022] GET /compute/v2.1/servers/73fc9558-1f91-4cbd-b5f1-9342dc7d6148 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:37:58.175803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-9ec91e12-c3e4-483e-a02d-e8593ccbaf0b req-bee8fbee-f922-4eea-b10e-07e18b767a49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f", "tag": "494a4e31-f22f-4879-99a8-4f1e34a92a8e"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:37:58.187105 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-9ec91e12-c3e4-483e-a02d-e8593ccbaf0b req-bee8fbee-f922-4eea-b10e-07e18b767a49 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:37:58.188271 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-9ec91e12-c3e4-483e-a02d-e8593ccbaf0b req-bee8fbee-f922-4eea-b10e-07e18b767a49 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:37:58.189478 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-9ec91e12-c3e4-483e-a02d-e8593ccbaf0b req-bee8fbee-f922-4eea-b10e-07e18b767a49 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:37:58.204959 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-9ec91e12-c3e4-483e-a02d-e8593ccbaf0b req-bee8fbee-f922-4eea-b10e-07e18b767a49 service nova] Creating event network-changed:494a4e31-f22f-4879-99a8-4f1e34a92a8e for instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f on hv-cinder-83124 Aug 19 16:37:58.211370 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-9ec91e12-c3e4-483e-a02d-e8593ccbaf0b req-bee8fbee-f922-4eea-b10e-07e18b767a49 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040097 Aug 19 16:37:58.212882 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 458/912] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:02.799661 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0622bc95-d80a-4a97-a8cc-8b6f41e4184b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3291477c-fa97-40f9-b4a7-84e92670521b"}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:38:02.802088 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-0622bc95-d80a-4a97-a8cc-8b6f41e4184b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:02.808543 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0622bc95-d80a-4a97-a8cc-8b6f41e4184b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:02.809056 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0622bc95-d80a-4a97-a8cc-8b6f41e4184b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:02.809490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0622bc95-d80a-4a97-a8cc-8b6f41e4184b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:02.810203 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0622bc95-d80a-4a97-a8cc-8b6f41e4184b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:02.810654 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0622bc95-d80a-4a97-a8cc-8b6f41e4184b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:02.811080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0622bc95-d80a-4a97-a8cc-8b6f41e4184b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:02.890598 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-0622bc95-d80a-4a97-a8cc-8b6f41e4184b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] HTTP exception thrown: Invalid volume: volume 3291477c-fa97-40f9-b4a7-84e92670521b is already attached to instances: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0622bc95-d80a-4a97-a8cc-8b6f41e4184b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Request method failure captured: Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: POST /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-volume_attachments HTTP/1.1 Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 74 Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7sAw9LcxO6N0pZY1nhZLJGTFHO5NOhvu1eVk6xTEodx-7uYGCVFosqHM2vYV2yCCDgERTbLEbTufj2duylmwK82XOJGkc69LfohAu5wx0GlI5NYAoHX6aVSGY0q6pl5_M_R0V-WnUvH1N5W6DXSAAPQV7ymDnRnchpgyuPHrFewp9k Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:38:02.892477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:38:02.894027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1743538991c8415394ac6cd5aed28d6a"}]}] Aug 19 16:38:02.894027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:38:02.894027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:38:02.894027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:38:02.894027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:38:02.894027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:38:02.894027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:38:02.894027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: 9b0455ae3ec94c929c940df6a0f6687d Aug 19 16:38:02.894027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:38:02.894027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Aug 19 16:38:02.894027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {"volumeAttachment": {"volumeId": "3291477c-fa97-40f9-b4a7-84e92670521b"}} Aug 19 16:38:02.894027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:38:02.894903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Invalid volume: volume 3291477c-fa97-40f9-b4a7-84e92670521b is already attached to instances: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e Aug 19 16:38:02.894903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'server_id': '171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e', 'body': {'volumeAttachment': {'volumeId': '3291477c-fa97-40f9-b4a7-84e92670521b'}}} Aug 19 16:38:02.894903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:38:02.894903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:38:02.894903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 19 16:38:02.894903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 19 16:38:02.894903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 19 16:38:02.894903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 19 16:38:02.894903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 19 16:38:02.894903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 19 16:38:02.894903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5119, in attach_volume Aug 19 16:38:02.894903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 19 16:38:02.894903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4959, in _check_volume_already_attached Aug 19 16:38:02.894903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 19 16:38:02.894903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3291477c-fa97-40f9-b4a7-84e92670521b is already attached to instances: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e Aug 19 16:38:02.894903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:38:02.894903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:38:02.894903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:38:02.894903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:38:02.896057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:38:02.896057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:38:02.896057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:38:02.896057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:38:02.896057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:38:02.896057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:38:02.896057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 16:38:02.896057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 16:38:02.896057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 16:38:02.896057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 16:38:02.896057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 19 16:38:02.896057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 19 16:38:02.896057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 19 16:38:02.896057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 19 16:38:02.896057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3291477c-fa97-40f9-b4a7-84e92670521b is already attached to instances: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e Aug 19 16:38:02.896057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:38:02.896057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:38:02.896057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:38:02.896057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:38:02.896057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:38:02.897335 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:38:02.897335 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:38:02.897335 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:38:02.897335 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3291477c-fa97-40f9-b4a7-84e92670521b is already attached to instances: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e Aug 19 16:38:02.897335 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:38:02.897335 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0622bc95-d80a-4a97-a8cc-8b6f41e4184b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Returning 400 to user: Invalid volume: volume 3291477c-fa97-40f9-b4a7-84e92670521b is already attached to instances: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:38:02.897335 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-0622bc95-d80a-4a97-a8cc-8b6f41e4184b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "POST /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099284 Aug 19 16:38:02.897335 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 455/913] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Aug 19 16:38:02 2022] POST /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 19 16:38:02.959619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-3df7138a-beda-4ef4-a6e3-575c241a082c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:02.960200 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-3df7138a-beda-4ef4-a6e3-575c241a082c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:02.962128 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:02.967459 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3df7138a-beda-4ef4-a6e3-575c241a082c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:02.967937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3df7138a-beda-4ef4-a6e3-575c241a082c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:02.968367 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3df7138a-beda-4ef4-a6e3-575c241a082c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:02.969091 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3df7138a-beda-4ef4-a6e3-575c241a082c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:02.969540 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3df7138a-beda-4ef4-a6e3-575c241a082c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:02.969957 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3df7138a-beda-4ef4-a6e3-575c241a082c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:03.049432 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.objects.instance [None req-3df7138a-beda-4ef4-a6e3-575c241a082c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lazy-loading 'services' on Instance uuid 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e {{(pid=127284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:38:03.123057 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-3df7138a-beda-4ef4-a6e3-575c241a082c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "DELETE /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-volume_attachments/3291477c-fa97-40f9-b4a7-84e92670521b" status: 202 len: 0 microversion: 2.1 time: 0.168123 Aug 19 16:38:03.124597 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 459/914] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Aug 19 16:38:02 2022] DELETE /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-volume_attachments/3291477c-fa97-40f9-b4a7-84e92670521b => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 19 16:38:03.134204 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-5cb6f88a-840c-48dc-bd85-5cdbf7d46656 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:03.136515 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-5cb6f88a-840c-48dc-bd85-5cdbf7d46656 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:03.143906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5cb6f88a-840c-48dc-bd85-5cdbf7d46656 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:03.144732 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5cb6f88a-840c-48dc-bd85-5cdbf7d46656 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:03.145271 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5cb6f88a-840c-48dc-bd85-5cdbf7d46656 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:03.146064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5cb6f88a-840c-48dc-bd85-5cdbf7d46656 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:03.146584 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5cb6f88a-840c-48dc-bd85-5cdbf7d46656 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:03.147083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5cb6f88a-840c-48dc-bd85-5cdbf7d46656 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:03.178275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-5cb6f88a-840c-48dc-bd85-5cdbf7d46656 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048959 Aug 19 16:38:03.178750 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 456/915] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:38:03 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:04.043158 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-6856502c-682d-4568-8a5c-2e85eb26879e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:04.046372 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-6856502c-682d-4568-8a5c-2e85eb26879e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:04.052772 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6856502c-682d-4568-8a5c-2e85eb26879e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:04.053198 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6856502c-682d-4568-8a5c-2e85eb26879e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:04.053636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6856502c-682d-4568-8a5c-2e85eb26879e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:04.054331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6856502c-682d-4568-8a5c-2e85eb26879e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:04.054783 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6856502c-682d-4568-8a5c-2e85eb26879e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:04.055205 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6856502c-682d-4568-8a5c-2e85eb26879e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:04.084072 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-6856502c-682d-4568-8a5c-2e85eb26879e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045649 Aug 19 16:38:04.084631 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 460/916] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:38:04 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 16:38:04.146218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a04628a8-d4f7-4605-b5f0-b6525f6667d7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:04.146725 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a04628a8-d4f7-4605-b5f0-b6525f6667d7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:04.153224 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a04628a8-d4f7-4605-b5f0-b6525f6667d7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:04.153709 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a04628a8-d4f7-4605-b5f0-b6525f6667d7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:04.154151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a04628a8-d4f7-4605-b5f0-b6525f6667d7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:04.155392 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a04628a8-d4f7-4605-b5f0-b6525f6667d7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:04.155848 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a04628a8-d4f7-4605-b5f0-b6525f6667d7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:04.156330 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a04628a8-d4f7-4605-b5f0-b6525f6667d7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:04.183601 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a04628a8-d4f7-4605-b5f0-b6525f6667d7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Going to try to terminate instance {{(pid=127285) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:38:04.191332 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-38dd0de1-2886-418e-a3fb-fa8adbea4f98 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:04.194186 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-38dd0de1-2886-418e-a3fb-fa8adbea4f98 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:04.202471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-38dd0de1-2886-418e-a3fb-fa8adbea4f98 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:04.203181 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-38dd0de1-2886-418e-a3fb-fa8adbea4f98 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:04.203685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-38dd0de1-2886-418e-a3fb-fa8adbea4f98 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:04.204452 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-38dd0de1-2886-418e-a3fb-fa8adbea4f98 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:04.204996 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-38dd0de1-2886-418e-a3fb-fa8adbea4f98 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:04.205774 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-38dd0de1-2886-418e-a3fb-fa8adbea4f98 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:04.246702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-38dd0de1-2886-418e-a3fb-fa8adbea4f98 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059968 Aug 19 16:38:04.247914 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 461/917] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:38:04 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:04.277356 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a04628a8-d4f7-4605-b5f0-b6525f6667d7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 204 len: 0 microversion: 2.1 time: 0.134593 Aug 19 16:38:04.278096 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 457/918] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:38:04 2022] DELETE /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:38:04.286549 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e38466b3-a3bb-41a6-8221-79d1c00839f7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:04.287158 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-e38466b3-a3bb-41a6-8221-79d1c00839f7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:04.293302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e38466b3-a3bb-41a6-8221-79d1c00839f7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:04.293787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e38466b3-a3bb-41a6-8221-79d1c00839f7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:04.295859 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e38466b3-a3bb-41a6-8221-79d1c00839f7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:04.296643 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e38466b3-a3bb-41a6-8221-79d1c00839f7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:04.297557 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e38466b3-a3bb-41a6-8221-79d1c00839f7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:04.298210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e38466b3-a3bb-41a6-8221-79d1c00839f7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:04.439225 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e38466b3-a3bb-41a6-8221-79d1c00839f7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:04.447159 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e38466b3-a3bb-41a6-8221-79d1c00839f7 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1674 microversion: 2.1 time: 0.164477 Aug 19 16:38:04.447720 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 462/919] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:04 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:05.260430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4a270395-3337-4e7a-9f5e-6668f19888ae tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:05.262680 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-4a270395-3337-4e7a-9f5e-6668f19888ae tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:05.269763 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4a270395-3337-4e7a-9f5e-6668f19888ae tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:05.270274 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4a270395-3337-4e7a-9f5e-6668f19888ae tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:05.270706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4a270395-3337-4e7a-9f5e-6668f19888ae tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:05.271389 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4a270395-3337-4e7a-9f5e-6668f19888ae tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:05.271848 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4a270395-3337-4e7a-9f5e-6668f19888ae tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:05.272272 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4a270395-3337-4e7a-9f5e-6668f19888ae tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:05.275870 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:05.305025 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4a270395-3337-4e7a-9f5e-6668f19888ae tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048829 Aug 19 16:38:05.305571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 458/920] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:38:05 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:05.468234 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c6f72024-e6e8-4647-8fef-f2f4e2139672 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:05.468909 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-c6f72024-e6e8-4647-8fef-f2f4e2139672 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:05.475433 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c6f72024-e6e8-4647-8fef-f2f4e2139672 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:05.475914 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c6f72024-e6e8-4647-8fef-f2f4e2139672 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:05.476347 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c6f72024-e6e8-4647-8fef-f2f4e2139672 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:05.477085 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c6f72024-e6e8-4647-8fef-f2f4e2139672 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:05.477536 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c6f72024-e6e8-4647-8fef-f2f4e2139672 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:05.477958 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c6f72024-e6e8-4647-8fef-f2f4e2139672 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:05.604511 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c6f72024-e6e8-4647-8fef-f2f4e2139672 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:05.612175 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c6f72024-e6e8-4647-8fef-f2f4e2139672 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1674 microversion: 2.1 time: 0.148002 Aug 19 16:38:05.612744 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 463/921] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:05 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:06.317508 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8916b654-7ce2-4703-b739-9f530234a286 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:06.319677 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8916b654-7ce2-4703-b739-9f530234a286 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:06.326253 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8916b654-7ce2-4703-b739-9f530234a286 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:06.326730 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8916b654-7ce2-4703-b739-9f530234a286 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:06.327369 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8916b654-7ce2-4703-b739-9f530234a286 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:06.328057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8916b654-7ce2-4703-b739-9f530234a286 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:06.328511 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8916b654-7ce2-4703-b739-9f530234a286 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:06.328967 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8916b654-7ce2-4703-b739-9f530234a286 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:06.357406 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8916b654-7ce2-4703-b739-9f530234a286 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043857 Aug 19 16:38:06.357947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 459/922] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:38:06 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:06.632709 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-267d1a26-c4ff-4b90-9597-7e9c52935074 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:06.633266 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-267d1a26-c4ff-4b90-9597-7e9c52935074 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:06.640266 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-267d1a26-c4ff-4b90-9597-7e9c52935074 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:06.640746 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-267d1a26-c4ff-4b90-9597-7e9c52935074 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:06.641215 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-267d1a26-c4ff-4b90-9597-7e9c52935074 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:06.641907 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-267d1a26-c4ff-4b90-9597-7e9c52935074 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:06.642359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-267d1a26-c4ff-4b90-9597-7e9c52935074 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:06.642780 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-267d1a26-c4ff-4b90-9597-7e9c52935074 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:06.776100 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-267d1a26-c4ff-4b90-9597-7e9c52935074 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:06.784489 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-267d1a26-c4ff-4b90-9597-7e9c52935074 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1674 microversion: 2.1 time: 0.155691 Aug 19 16:38:06.785066 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 464/923] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:06 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:07.370246 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-9cc4f13d-9b3c-48dd-b54e-61fca2ce9321 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:07.372392 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-9cc4f13d-9b3c-48dd-b54e-61fca2ce9321 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:07.374849 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:07.380100 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9cc4f13d-9b3c-48dd-b54e-61fca2ce9321 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:07.380586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9cc4f13d-9b3c-48dd-b54e-61fca2ce9321 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:07.381139 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9cc4f13d-9b3c-48dd-b54e-61fca2ce9321 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:07.381980 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9cc4f13d-9b3c-48dd-b54e-61fca2ce9321 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:07.382540 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9cc4f13d-9b3c-48dd-b54e-61fca2ce9321 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:07.383062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9cc4f13d-9b3c-48dd-b54e-61fca2ce9321 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:07.414255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-9cc4f13d-9b3c-48dd-b54e-61fca2ce9321 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048110 Aug 19 16:38:07.414800 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 460/924] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:38:07 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:07.809513 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-beeb32e2-a819-4d4b-9e4f-0ae25866ce50 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:07.809513 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-beeb32e2-a819-4d4b-9e4f-0ae25866ce50 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:07.813324 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-beeb32e2-a819-4d4b-9e4f-0ae25866ce50 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:07.813805 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-beeb32e2-a819-4d4b-9e4f-0ae25866ce50 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:07.814242 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-beeb32e2-a819-4d4b-9e4f-0ae25866ce50 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:07.814931 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-beeb32e2-a819-4d4b-9e4f-0ae25866ce50 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:07.815377 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-beeb32e2-a819-4d4b-9e4f-0ae25866ce50 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:07.815798 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-beeb32e2-a819-4d4b-9e4f-0ae25866ce50 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:07.958734 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-beeb32e2-a819-4d4b-9e4f-0ae25866ce50 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:07.966608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-beeb32e2-a819-4d4b-9e4f-0ae25866ce50 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1674 microversion: 2.1 time: 0.165118 Aug 19 16:38:07.967243 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 465/925] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:07 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:08.427355 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-096d0d35-0ca1-46cd-bfd4-24eee00126fe tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:08.429591 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-096d0d35-0ca1-46cd-bfd4-24eee00126fe tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:08.435978 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-096d0d35-0ca1-46cd-bfd4-24eee00126fe tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:08.436776 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-096d0d35-0ca1-46cd-bfd4-24eee00126fe tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:08.437288 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-096d0d35-0ca1-46cd-bfd4-24eee00126fe tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:08.437989 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-096d0d35-0ca1-46cd-bfd4-24eee00126fe tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:08.438444 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-096d0d35-0ca1-46cd-bfd4-24eee00126fe tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:08.438872 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-096d0d35-0ca1-46cd-bfd4-24eee00126fe tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:08.471019 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-096d0d35-0ca1-46cd-bfd4-24eee00126fe tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047680 Aug 19 16:38:08.471587 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 461/926] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:38:08 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 19 16:38:08.533279 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-58325057-0f0b-42d2-8083-d30e6f988c3b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:08.533780 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-58325057-0f0b-42d2-8083-d30e6f988c3b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:08.539699 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-58325057-0f0b-42d2-8083-d30e6f988c3b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:08.540181 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-58325057-0f0b-42d2-8083-d30e6f988c3b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:08.540617 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-58325057-0f0b-42d2-8083-d30e6f988c3b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:08.541357 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-58325057-0f0b-42d2-8083-d30e6f988c3b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:08.541811 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-58325057-0f0b-42d2-8083-d30e6f988c3b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:08.542255 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-58325057-0f0b-42d2-8083-d30e6f988c3b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:08.567863 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-58325057-0f0b-42d2-8083-d30e6f988c3b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Going to try to terminate instance {{(pid=127284) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:38:08.651809 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-58325057-0f0b-42d2-8083-d30e6f988c3b tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "DELETE /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 204 len: 0 microversion: 2.1 time: 0.122619 Aug 19 16:38:08.660974 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 466/927] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:38:08 2022] DELETE /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:38:08.666316 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b28dbbc0-4ec2-47ed-b1f3-544189e05890 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:08.666961 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b28dbbc0-4ec2-47ed-b1f3-544189e05890 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:08.674460 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b28dbbc0-4ec2-47ed-b1f3-544189e05890 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:08.675168 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b28dbbc0-4ec2-47ed-b1f3-544189e05890 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:08.675456 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b28dbbc0-4ec2-47ed-b1f3-544189e05890 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:08.676260 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b28dbbc0-4ec2-47ed-b1f3-544189e05890 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:08.676915 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b28dbbc0-4ec2-47ed-b1f3-544189e05890 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:08.677354 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b28dbbc0-4ec2-47ed-b1f3-544189e05890 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:08.991738 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-41154f46-b203-411f-85cf-3488eb596d6e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:08.991738 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-41154f46-b203-411f-85cf-3488eb596d6e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:08.997905 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-41154f46-b203-411f-85cf-3488eb596d6e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:08.998587 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-41154f46-b203-411f-85cf-3488eb596d6e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:08.999963 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-41154f46-b203-411f-85cf-3488eb596d6e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:09.000670 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-41154f46-b203-411f-85cf-3488eb596d6e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:09.001152 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-41154f46-b203-411f-85cf-3488eb596d6e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:09.001748 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-41154f46-b203-411f-85cf-3488eb596d6e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:09.018638 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:09.162018 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b28dbbc0-4ec2-47ed-b1f3-544189e05890 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:09.167806 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-41154f46-b203-411f-85cf-3488eb596d6e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:09.173580 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b28dbbc0-4ec2-47ed-b1f3-544189e05890 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1682 microversion: 2.1 time: 0.510840 Aug 19 16:38:09.174673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 462/928] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:08 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1682 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:09.177033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-41154f46-b203-411f-85cf-3488eb596d6e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1674 microversion: 2.1 time: 0.192481 Aug 19 16:38:09.191062 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 467/929] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:08 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1674 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:38:09.716981 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-78c64aaa-f055-40d1-8c0b-f7760fec70bf req-b47086db-1697-40ac-bf34-049c12f0447b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1eddf01-3fc7-4c5c-8560-96cddb34a199", "name": "network-vif-deleted", "tag": "f7152602-0c68-468a-8871-72cc6f1ab0dc"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:38:09.727036 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-78c64aaa-f055-40d1-8c0b-f7760fec70bf req-b47086db-1697-40ac-bf34-049c12f0447b service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:09.727506 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-78c64aaa-f055-40d1-8c0b-f7760fec70bf req-b47086db-1697-40ac-bf34-049c12f0447b service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:09.727926 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-78c64aaa-f055-40d1-8c0b-f7760fec70bf req-b47086db-1697-40ac-bf34-049c12f0447b service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:09.740059 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-78c64aaa-f055-40d1-8c0b-f7760fec70bf req-b47086db-1697-40ac-bf34-049c12f0447b service nova] Creating event network-vif-deleted:f7152602-0c68-468a-8871-72cc6f1ab0dc for instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 on hv-cinder-83124 Aug 19 16:38:09.745264 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-78c64aaa-f055-40d1-8c0b-f7760fec70bf req-b47086db-1697-40ac-bf34-049c12f0447b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031931 Aug 19 16:38:09.745931 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 463/930] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:10.196409 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-46a22c03-7f0b-4313-9eec-311882122e28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:10.197669 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-46a22c03-7f0b-4313-9eec-311882122e28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:10.199285 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-dc538d36-26d5-43f8-87d3-a69c9e6f1b01 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:10.201042 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-dc538d36-26d5-43f8-87d3-a69c9e6f1b01 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:10.204233 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-46a22c03-7f0b-4313-9eec-311882122e28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:10.204718 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-46a22c03-7f0b-4313-9eec-311882122e28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:10.205178 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-46a22c03-7f0b-4313-9eec-311882122e28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:10.205872 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-46a22c03-7f0b-4313-9eec-311882122e28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:10.206327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-46a22c03-7f0b-4313-9eec-311882122e28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:10.206751 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-46a22c03-7f0b-4313-9eec-311882122e28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:10.207789 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dc538d36-26d5-43f8-87d3-a69c9e6f1b01 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:10.208737 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dc538d36-26d5-43f8-87d3-a69c9e6f1b01 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:10.209210 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dc538d36-26d5-43f8-87d3-a69c9e6f1b01 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:10.209900 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dc538d36-26d5-43f8-87d3-a69c9e6f1b01 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:10.210815 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dc538d36-26d5-43f8-87d3-a69c9e6f1b01 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:10.211239 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dc538d36-26d5-43f8-87d3-a69c9e6f1b01 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:10.281022 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-dc538d36-26d5-43f8-87d3-a69c9e6f1b01 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:10.290518 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-dc538d36-26d5-43f8-87d3-a69c9e6f1b01 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1606 microversion: 2.1 time: 0.095516 Aug 19 16:38:10.304716 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 464/931] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:10 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1606 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:38:10.347599 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-46a22c03-7f0b-4313-9eec-311882122e28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:10.355506 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-46a22c03-7f0b-4313-9eec-311882122e28 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1682 microversion: 2.1 time: 0.163256 Aug 19 16:38:10.356083 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 468/932] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:10 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:11.312170 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b2647da2-bc2d-4b12-b3c2-aa4aefeb46ef tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:11.312996 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b2647da2-bc2d-4b12-b3c2-aa4aefeb46ef tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:11.320429 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b2647da2-bc2d-4b12-b3c2-aa4aefeb46ef tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:11.321066 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b2647da2-bc2d-4b12-b3c2-aa4aefeb46ef tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:11.321614 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b2647da2-bc2d-4b12-b3c2-aa4aefeb46ef tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:11.322396 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b2647da2-bc2d-4b12-b3c2-aa4aefeb46ef tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:11.322953 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b2647da2-bc2d-4b12-b3c2-aa4aefeb46ef tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:11.323448 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b2647da2-bc2d-4b12-b3c2-aa4aefeb46ef tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:11.357155 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b2647da2-bc2d-4b12-b3c2-aa4aefeb46ef tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:11.357648 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b2647da2-bc2d-4b12-b3c2-aa4aefeb46ef tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:11.358585 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b2647da2-bc2d-4b12-b3c2-aa4aefeb46ef tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:11.359369 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.objects.instance [None req-b2647da2-bc2d-4b12-b3c2-aa4aefeb46ef tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lazy-loading 'fault' on Instance uuid a1eddf01-3fc7-4c5c-8560-96cddb34a199 {{(pid=127285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:38:11.377285 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a540b238-c52e-44d9-8e6f-8f1012d4266e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:11.377903 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a540b238-c52e-44d9-8e6f-8f1012d4266e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:11.384253 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a540b238-c52e-44d9-8e6f-8f1012d4266e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:11.384741 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a540b238-c52e-44d9-8e6f-8f1012d4266e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:11.385210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a540b238-c52e-44d9-8e6f-8f1012d4266e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:11.385911 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a540b238-c52e-44d9-8e6f-8f1012d4266e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:11.386373 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a540b238-c52e-44d9-8e6f-8f1012d4266e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:11.386803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a540b238-c52e-44d9-8e6f-8f1012d4266e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:11.409110 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b2647da2-bc2d-4b12-b3c2-aa4aefeb46ef tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:11.417724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b2647da2-bc2d-4b12-b3c2-aa4aefeb46ef tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 200 len: 1328 microversion: 2.1 time: 0.110095 Aug 19 16:38:11.418800 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 465/933] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:11 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 1328 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:11.547009 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a540b238-c52e-44d9-8e6f-8f1012d4266e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:11.554735 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a540b238-c52e-44d9-8e6f-8f1012d4266e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1682 microversion: 2.1 time: 0.182304 Aug 19 16:38:11.555331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 469/934] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:11 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:38:12.144435 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-c5ae853c-08a9-49de-bb48-28418b16fe9d req-63031090-8396-4412-9c4e-9af49f0f03f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e", "name": "network-vif-deleted", "tag": "30a130c9-8de6-4d0c-bdd1-a2642504988a"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:38:12.156446 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-c5ae853c-08a9-49de-bb48-28418b16fe9d req-63031090-8396-4412-9c4e-9af49f0f03f2 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:12.157299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-c5ae853c-08a9-49de-bb48-28418b16fe9d req-63031090-8396-4412-9c4e-9af49f0f03f2 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:12.157905 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-c5ae853c-08a9-49de-bb48-28418b16fe9d req-63031090-8396-4412-9c4e-9af49f0f03f2 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:12.363156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-c5ae853c-08a9-49de-bb48-28418b16fe9d req-63031090-8396-4412-9c4e-9af49f0f03f2 service nova] Creating event network-vif-deleted:30a130c9-8de6-4d0c-bdd1-a2642504988a for instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e on hv-cinder-83124 Aug 19 16:38:12.369313 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-c5ae853c-08a9-49de-bb48-28418b16fe9d req-63031090-8396-4412-9c4e-9af49f0f03f2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228511 Aug 19 16:38:12.370701 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 466/935] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:12.442431 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-553772f9-02c0-4577-8e4f-1a2e58c53a6c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:12.442966 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-553772f9-02c0-4577-8e4f-1a2e58c53a6c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:12.449949 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-553772f9-02c0-4577-8e4f-1a2e58c53a6c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:12.450558 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-553772f9-02c0-4577-8e4f-1a2e58c53a6c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:12.451177 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-553772f9-02c0-4577-8e4f-1a2e58c53a6c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:12.452193 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-553772f9-02c0-4577-8e4f-1a2e58c53a6c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:12.452826 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-553772f9-02c0-4577-8e4f-1a2e58c53a6c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:12.453643 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-553772f9-02c0-4577-8e4f-1a2e58c53a6c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:12.470884 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-553772f9-02c0-4577-8e4f-1a2e58c53a6c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] HTTP exception thrown: Instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 could not be found. Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-553772f9-02c0-4577-8e4f-1a2e58c53a6c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Request method failure captured: Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 HTTP/1.1 Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7sEsq1PtiZN4apoXaUUVhZq5WWlx5ZN_L-k1CpYa9U8U0yJgQWrekR3pqZNU--GCFfzY1eONTPx_Og-ypg_M0J6cAF5i3MJBNciikCwmAhcw4dEdfvO2G4DFJ0nuxAQOpyqe6mznIEPIZ4yEqSSMRD_IBzNSlULA4ROXu-8Zy8w3uk Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: e15ca27a2c874997bd01de973a948311 Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-AttachVolumeTestJSON-1651088909 Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:38:12.473043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:38:12.474592 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e15ca27a2c874997bd01de973a948311"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e15ca27a2c874997bd01de973a948311"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e15ca27a2c874997bd01de973a948311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e15ca27a2c874997bd01de973a948311"}]}] Aug 19 16:38:12.474592 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-AttachVolumeTestJSON-1651088909 Aug 19 16:38:12.474592 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: e15ca27a2c874997bd01de973a948311 Aug 19 16:38:12.474592 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1651088909 Aug 19 16:38:12.474592 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-AttachVolumeTestJSON-1651088909-project Aug 19 16:38:12.474592 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:38:12.474592 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:38:12.474592 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: d55dc52ab80642da90f05e74092ffdf8 Aug 19 16:38:12.474592 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-AttachVolumeTestJSON-1651088909-project Aug 19 16:38:12.474592 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:38:12.474592 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 could not be found. Aug 19 16:38:12.474592 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': 'a1eddf01-3fc7-4c5c-8560-96cddb34a199'} Aug 19 16:38:12.475490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:38:12.475490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:38:12.475490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:38:12.475490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:38:12.475490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:38:12.475490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:38:12.475490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:38:12.475490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:38:12.475490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:38:12.475490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:38:12.475490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 could not be found. Aug 19 16:38:12.475490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:38:12.475490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:38:12.475490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:38:12.475490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:38:12.475490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:38:12.475490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:38:12.475490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:38:12.475490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:38:12.475490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:38:12.476897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:38:12.476897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:38:12.476897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:38:12.476897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:38:12.476897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:38:12.476897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:38:12.476897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:38:12.476897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 could not be found. Aug 19 16:38:12.476897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:38:12.476897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:38:12.476897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:38:12.476897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:38:12.476897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:38:12.476897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:38:12.476897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:38:12.476897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:38:12.476897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 could not be found. Aug 19 16:38:12.476897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:38:12.479254 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-553772f9-02c0-4577-8e4f-1a2e58c53a6c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Returning 404 to user: Instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:38:12.480250 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-553772f9-02c0-4577-8e4f-1a2e58c53a6c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 404 len: 111 microversion: 2.1 time: 0.044054 Aug 19 16:38:12.481435 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 470/936] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:12 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:38:12.493700 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-759b2a2f-ff41-405b-be38-95f9036d8963 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '.version_select at 0x7fb0228214c0>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:12.530457 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-759b2a2f-ff41-405b-be38-95f9036d8963 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1876633714" status: 202 len: 0 microversion: 2.1 time: 0.043006 Aug 19 16:38:12.532835 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 467/937] 10.222.0.55 () {58 vars in 1221 bytes} [Fri Aug 19 16:38:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1876633714 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:38:12.576226 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f886b01a-6dcc-469d-a00f-730e5c44ea0c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:12.577538 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f886b01a-6dcc-469d-a00f-730e5c44ea0c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:12.584249 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f886b01a-6dcc-469d-a00f-730e5c44ea0c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:12.585289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f886b01a-6dcc-469d-a00f-730e5c44ea0c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:12.586155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f886b01a-6dcc-469d-a00f-730e5c44ea0c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:12.587385 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f886b01a-6dcc-469d-a00f-730e5c44ea0c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:12.588067 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f886b01a-6dcc-469d-a00f-730e5c44ea0c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:12.588711 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f886b01a-6dcc-469d-a00f-730e5c44ea0c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:12.633130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f886b01a-6dcc-469d-a00f-730e5c44ea0c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:12.633905 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f886b01a-6dcc-469d-a00f-730e5c44ea0c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:12.634558 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f886b01a-6dcc-469d-a00f-730e5c44ea0c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:12.635192 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.objects.instance [None req-f886b01a-6dcc-469d-a00f-730e5c44ea0c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lazy-loading 'fault' on Instance uuid 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e {{(pid=127284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:38:12.696554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f886b01a-6dcc-469d-a00f-730e5c44ea0c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:12.705278 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f886b01a-6dcc-469d-a00f-730e5c44ea0c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 200 len: 1331 microversion: 2.1 time: 0.132722 Aug 19 16:38:12.709375 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 471/938] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:12 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 1331 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:13.279028 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ccb7b3b4-1cac-4518-9b1a-0f58063136ad tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Action: 'create', calling method: .version_select at 0x7fb02284ac10>, body: {"keypair": {"name": "tempest-keypair-1396876584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILlVprhycPhh3rNMxuLRiORNX+o7+mKRhb8kgVrKypuoaYf2BTzz8E6cApTv6+mlS8vnDOR3pETN04hZnbjO3zUXXv47geYlmuYY8YLnoyglpWWTyUpnfSWygTDlE/56w=="}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:38:13.299704 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-ccb7b3b4-1cac-4518-9b1a-0f58063136ad tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Getting quotas for project e15ca27a2c874997bd01de973a948311. Resources: {'key_pairs'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:38:13.304709 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-ccb7b3b4-1cac-4518-9b1a-0f58063136ad tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Getting quotas for user d55dc52ab80642da90f05e74092ffdf8 and project e15ca27a2c874997bd01de973a948311. Resources: {'key_pairs'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:38:13.327895 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ccb7b3b4-1cac-4518-9b1a-0f58063136ad tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055517 Aug 19 16:38:13.328493 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 468/939] 10.222.0.55 () {60 vars in 1159 bytes} [Fri Aug 19 16:38:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:13.728296 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-374476f6-edeb-4207-9020-8dc72bb64327 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:13.728993 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-374476f6-edeb-4207-9020-8dc72bb64327 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:13.736929 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-374476f6-edeb-4207-9020-8dc72bb64327 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:13.737605 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-374476f6-edeb-4207-9020-8dc72bb64327 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:13.737821 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-374476f6-edeb-4207-9020-8dc72bb64327 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:13.738628 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-374476f6-edeb-4207-9020-8dc72bb64327 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:13.739089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-374476f6-edeb-4207-9020-8dc72bb64327 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:13.739656 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-374476f6-edeb-4207-9020-8dc72bb64327 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:13.754667 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-374476f6-edeb-4207-9020-8dc72bb64327 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] HTTP exception thrown: Instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e could not be found. Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-374476f6-edeb-4207-9020-8dc72bb64327 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Request method failure captured: Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e HTTP/1.1 Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7sAw9LcxO6N0pZY1nhZLJGTFHO5NOhvu1eVk6xTEodx-7uYGCVFosqHM2vYV2yCCDgERTbLEbTufj2duylmwK82XOJGkc69LfohAu5wx0GlI5NYAoHX6aVSGY0q6pl5_M_R0V-WnUvH1N5W6DXSAAPQV7ymDnRnchpgyuPHrFewp9k Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:38:13.756280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:38:13.757900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1743538991c8415394ac6cd5aed28d6a"}]}] Aug 19 16:38:13.757900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:38:13.757900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:38:13.757900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:38:13.757900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:38:13.757900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:38:13.757900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:38:13.757900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: 9b0455ae3ec94c929c940df6a0f6687d Aug 19 16:38:13.757900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:38:13.757900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:38:13.757900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e could not be found. Aug 19 16:38:13.757900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': '171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e'} Aug 19 16:38:13.759209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:38:13.759209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:38:13.759209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:38:13.759209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:38:13.759209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:38:13.759209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:38:13.759209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:38:13.759209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:38:13.759209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:38:13.759209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:38:13.759209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e could not be found. Aug 19 16:38:13.759209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:38:13.759209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:38:13.759209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:38:13.759209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:38:13.759209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:38:13.759209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:38:13.759209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:38:13.759209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:38:13.759209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:38:13.760817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:38:13.760817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:38:13.760817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:38:13.760817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:38:13.760817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:38:13.760817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:38:13.760817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:38:13.760817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e could not be found. Aug 19 16:38:13.760817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:38:13.760817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:38:13.760817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:38:13.760817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:38:13.760817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:38:13.760817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:38:13.760817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:38:13.760817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:38:13.760817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e could not be found. Aug 19 16:38:13.760817 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:38:13.762219 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-374476f6-edeb-4207-9020-8dc72bb64327 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Returning 404 to user: Instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:38:13.762219 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-374476f6-edeb-4207-9020-8dc72bb64327 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 404 len: 111 microversion: 2.1 time: 0.034584 Aug 19 16:38:13.762219 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 472/940] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:13 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:38:13.768350 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-14d98ede-cc64-4953-bce5-ec562d75c3ce tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '.version_select at 0x7fb02284a670>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:13.789397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-14d98ede-cc64-4953-bce5-ec562d75c3ce tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-696143613" status: 202 len: 0 microversion: 2.1 time: 0.026096 Aug 19 16:38:13.790356 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 469/941] 10.222.0.55 () {58 vars in 1218 bytes} [Fri Aug 19 16:38:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-696143613 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:38:14.560214 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b656a0a5-ea92-45d5-8ce5-ad525d545536 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Action: 'create', calling method: .version_select at 0x7fb01e0c88b0>, body: {"keypair": {"name": "tempest-keypair-1515338577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7Ju23hLkKTZwvfLLQYoekgUOsMV5UbQ25bcG7GzbAX3NzKP+oCiRpUwm2hpQdHHXCy/5DT3+kiD+/mrbKQr0yJ4xluOC9MtxM/Wk6e9XJjc/zz+PGtmKMO2CQHRFTPsQ=="}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:38:14.577642 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-b656a0a5-ea92-45d5-8ce5-ad525d545536 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Getting quotas for project 1743538991c8415394ac6cd5aed28d6a. Resources: {'key_pairs'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:38:14.582087 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-b656a0a5-ea92-45d5-8ce5-ad525d545536 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Getting quotas for user 9b0455ae3ec94c929c940df6a0f6687d and project 1743538991c8415394ac6cd5aed28d6a. Resources: {'key_pairs'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:38:14.617340 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b656a0a5-ea92-45d5-8ce5-ad525d545536 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061002 Aug 19 16:38:14.617948 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 473/942] 10.222.0.55 () {60 vars in 1159 bytes} [Fri Aug 19 16:38:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:14.810783 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-34e37aae-8556-4795-b41b-cfe2446dcf4f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-110713295", "imageRef": "da4af7b7-e205-4511-ad99-3478c2523f74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a90442a0-4e78-4b3b-919f-cf6c0969f007"}], "security_groups": [{"name": "tempest-securitygroup--2011847742"}], "key_name": "tempest-keypair-1396876584", "user_data": "}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:38:14.943634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.network.neutron [None req-34e37aae-8556-4795-b41b-cfe2446dcf4f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] validate_networks() for [('a90442a0-4e78-4b3b-919f-cf6c0969f007', None, None, None, None, None)] {{(pid=127285) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:38:15.381299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-34e37aae-8556-4795-b41b-cfe2446dcf4f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Flavor limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:38:15.381717 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-34e37aae-8556-4795-b41b-cfe2446dcf4f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Image limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:38:15.382180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-34e37aae-8556-4795-b41b-cfe2446dcf4f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Flavor pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:38:15.382900 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-34e37aae-8556-4795-b41b-cfe2446dcf4f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Image pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:38:15.383485 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-34e37aae-8556-4795-b41b-cfe2446dcf4f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:38:15.393198 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-34e37aae-8556-4795-b41b-cfe2446dcf4f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:15.393912 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-34e37aae-8556-4795-b41b-cfe2446dcf4f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:15.394328 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-34e37aae-8556-4795-b41b-cfe2446dcf4f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:15.395227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-34e37aae-8556-4795-b41b-cfe2446dcf4f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:15.395677 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-34e37aae-8556-4795-b41b-cfe2446dcf4f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:15.396277 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-34e37aae-8556-4795-b41b-cfe2446dcf4f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:15.414289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-34e37aae-8556-4795-b41b-cfe2446dcf4f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Getting quotas for project e15ca27a2c874997bd01de973a948311. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:38:15.418546 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-34e37aae-8556-4795-b41b-cfe2446dcf4f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Getting quotas for user d55dc52ab80642da90f05e74092ffdf8 and project e15ca27a2c874997bd01de973a948311. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:38:15.432363 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-34e37aae-8556-4795-b41b-cfe2446dcf4f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Going to run 1 instances... {{(pid=127285) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:38:15.434763 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-34e37aae-8556-4795-b41b-cfe2446dcf4f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='da4af7b7-e205-4511-ad99-3478c2523f74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127285) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:38:15.483144 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-34e37aae-8556-4795-b41b-cfe2446dcf4f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.679513 Aug 19 16:38:15.484149 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 470/943] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Aug 19 16:38:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 19 16:38:15.495948 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-4546b731-7afc-4f9f-8156-a114305a1414 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:15.497433 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-4546b731-7afc-4f9f-8156-a114305a1414 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:15.593250 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-4546b731-7afc-4f9f-8156-a114305a1414 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:15.601269 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-4546b731-7afc-4f9f-8156-a114305a1414 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542" status: 200 len: 1237 microversion: 2.1 time: 0.110111 Aug 19 16:38:15.602150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 474/944] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:15 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 => generated 1237 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:16.169617 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-414f7d90-b0ef-4024-8899-a4bcd3738aa0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-260732967", "imageRef": "da4af7b7-e205-4511-ad99-3478c2523f74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f05c65e5-ca4c-4b49-b86f-b320d0d9f99a"}], "security_groups": [{"name": "tempest-securitygroup--1078117730"}], "key_name": "tempest-keypair-1515338577", "user_data": "}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:38:16.283364 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.network.neutron [None req-414f7d90-b0ef-4024-8899-a4bcd3738aa0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] validate_networks() for [('f05c65e5-ca4c-4b49-b86f-b320d0d9f99a', None, None, None, None, None)] {{(pid=127285) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:38:16.630397 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-681462d4-46f7-45ea-8737-01e3d3c078cc tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:16.631248 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-681462d4-46f7-45ea-8737-01e3d3c078cc tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:16.645681 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-681462d4-46f7-45ea-8737-01e3d3c078cc tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:16.646585 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-681462d4-46f7-45ea-8737-01e3d3c078cc tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:16.647779 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-681462d4-46f7-45ea-8737-01e3d3c078cc tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:16.649252 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-681462d4-46f7-45ea-8737-01e3d3c078cc tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:16.650537 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-681462d4-46f7-45ea-8737-01e3d3c078cc tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:16.653507 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-681462d4-46f7-45ea-8737-01e3d3c078cc tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:16.714348 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-414f7d90-b0ef-4024-8899-a4bcd3738aa0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Flavor limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:38:16.715055 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-414f7d90-b0ef-4024-8899-a4bcd3738aa0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Image limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:38:16.715523 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-414f7d90-b0ef-4024-8899-a4bcd3738aa0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Flavor pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:38:16.716140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-414f7d90-b0ef-4024-8899-a4bcd3738aa0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Image pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:38:16.716457 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-414f7d90-b0ef-4024-8899-a4bcd3738aa0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:38:16.726760 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-414f7d90-b0ef-4024-8899-a4bcd3738aa0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:16.727465 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-414f7d90-b0ef-4024-8899-a4bcd3738aa0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:16.728439 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-414f7d90-b0ef-4024-8899-a4bcd3738aa0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:16.729551 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-414f7d90-b0ef-4024-8899-a4bcd3738aa0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:16.730184 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-414f7d90-b0ef-4024-8899-a4bcd3738aa0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:16.730770 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-414f7d90-b0ef-4024-8899-a4bcd3738aa0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:16.731236 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-681462d4-46f7-45ea-8737-01e3d3c078cc tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:16.740114 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-681462d4-46f7-45ea-8737-01e3d3c078cc tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542" status: 200 len: 1289 microversion: 2.1 time: 0.120147 Aug 19 16:38:16.740854 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 475/945] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:16 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 => generated 1289 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:16.752313 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-414f7d90-b0ef-4024-8899-a4bcd3738aa0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Getting quotas for project 1743538991c8415394ac6cd5aed28d6a. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:38:16.756209 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-414f7d90-b0ef-4024-8899-a4bcd3738aa0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Getting quotas for user 9b0455ae3ec94c929c940df6a0f6687d and project 1743538991c8415394ac6cd5aed28d6a. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:38:16.768173 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-414f7d90-b0ef-4024-8899-a4bcd3738aa0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Going to run 1 instances... {{(pid=127285) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:38:16.770610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-414f7d90-b0ef-4024-8899-a4bcd3738aa0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='da4af7b7-e205-4511-ad99-3478c2523f74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127285) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:38:16.833549 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-414f7d90-b0ef-4024-8899-a4bcd3738aa0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.669472 Aug 19 16:38:16.841569 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 471/946] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Aug 19 16:38:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 16:38:16.854351 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a22e4886-250c-4b82-a9a8-07b2115c7d47 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:16.855248 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a22e4886-250c-4b82-a9a8-07b2115c7d47 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:16.971951 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a22e4886-250c-4b82-a9a8-07b2115c7d47 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:16.980061 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a22e4886-250c-4b82-a9a8-07b2115c7d47 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1" status: 200 len: 1241 microversion: 2.1 time: 0.130587 Aug 19 16:38:16.980638 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 476/947] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:16 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 => generated 1241 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:17.762435 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d2c41240-cfcd-44b6-9bc7-6b5c3a53e81c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:17.763334 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d2c41240-cfcd-44b6-9bc7-6b5c3a53e81c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:17.771017 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2c41240-cfcd-44b6-9bc7-6b5c3a53e81c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:17.771498 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2c41240-cfcd-44b6-9bc7-6b5c3a53e81c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:17.772108 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2c41240-cfcd-44b6-9bc7-6b5c3a53e81c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:17.772823 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2c41240-cfcd-44b6-9bc7-6b5c3a53e81c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:17.773453 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2c41240-cfcd-44b6-9bc7-6b5c3a53e81c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:17.773927 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2c41240-cfcd-44b6-9bc7-6b5c3a53e81c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:17.806621 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-25d3f343-0bb7-4aad-b147-b7f5fcf821c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:17.807742 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-25d3f343-0bb7-4aad-b147-b7f5fcf821c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:17.816800 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-25d3f343-0bb7-4aad-b147-b7f5fcf821c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:17.817536 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-25d3f343-0bb7-4aad-b147-b7f5fcf821c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:17.818143 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-25d3f343-0bb7-4aad-b147-b7f5fcf821c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:17.818972 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-25d3f343-0bb7-4aad-b147-b7f5fcf821c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:17.819932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-25d3f343-0bb7-4aad-b147-b7f5fcf821c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:17.820954 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-25d3f343-0bb7-4aad-b147-b7f5fcf821c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:17.851634 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-25d3f343-0bb7-4aad-b147-b7f5fcf821c5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c/ips" status: 200 len: 150 microversion: 2.20 time: 0.049202 Aug 19 16:38:17.852363 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 477/948] 10.222.0.55 () {60 vars in 1289 bytes} [Fri Aug 19 16:38:17 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 16:38:17.864202 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d2c41240-cfcd-44b6-9bc7-6b5c3a53e81c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:17.872395 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d2c41240-cfcd-44b6-9bc7-6b5c3a53e81c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542" status: 200 len: 1295 microversion: 2.1 time: 0.113865 Aug 19 16:38:17.873922 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 472/949] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:17 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 => generated 1295 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:18.007217 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-42af8522-0187-4b24-941f-a97c0e848395 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:18.007856 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-42af8522-0187-4b24-941f-a97c0e848395 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:18.016407 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-42af8522-0187-4b24-941f-a97c0e848395 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:18.017141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-42af8522-0187-4b24-941f-a97c0e848395 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:18.017920 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-42af8522-0187-4b24-941f-a97c0e848395 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:18.020915 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-42af8522-0187-4b24-941f-a97c0e848395 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:18.021609 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-42af8522-0187-4b24-941f-a97c0e848395 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:18.022346 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-42af8522-0187-4b24-941f-a97c0e848395 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:18.141940 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-42af8522-0187-4b24-941f-a97c0e848395 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:18.153902 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-42af8522-0187-4b24-941f-a97c0e848395 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1" status: 200 len: 1293 microversion: 2.1 time: 0.153628 Aug 19 16:38:18.160170 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 478/950] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:17 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 => generated 1293 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:18.780405 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-b6f02693-245c-45b4-97f6-d58c096a8a61 req-ac92a65d-cad3-493e-aac0-2f780054e222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99fc027-bd6e-4ba2-9beb-d7277f387542", "tag": "1e7ac66a-3d3d-4107-909c-ab6a1732405a"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:38:18.795807 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-b6f02693-245c-45b4-97f6-d58c096a8a61 req-ac92a65d-cad3-493e-aac0-2f780054e222 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:18.797113 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-b6f02693-245c-45b4-97f6-d58c096a8a61 req-ac92a65d-cad3-493e-aac0-2f780054e222 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:18.798527 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-b6f02693-245c-45b4-97f6-d58c096a8a61 req-ac92a65d-cad3-493e-aac0-2f780054e222 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:18.814572 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-b6f02693-245c-45b4-97f6-d58c096a8a61 req-ac92a65d-cad3-493e-aac0-2f780054e222 service nova] Creating event network-changed:1e7ac66a-3d3d-4107-909c-ab6a1732405a for instance d99fc027-bd6e-4ba2-9beb-d7277f387542 on hv-cinder-83124 Aug 19 16:38:18.822741 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-b6f02693-245c-45b4-97f6-d58c096a8a61 req-ac92a65d-cad3-493e-aac0-2f780054e222 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049264 Aug 19 16:38:18.823929 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 473/951] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:18.895386 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ff72bf26-7a69-48bc-a158-40dfcebdbede tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:18.896798 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ff72bf26-7a69-48bc-a158-40dfcebdbede tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:18.903873 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ff72bf26-7a69-48bc-a158-40dfcebdbede tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:18.905176 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ff72bf26-7a69-48bc-a158-40dfcebdbede tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:18.906306 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ff72bf26-7a69-48bc-a158-40dfcebdbede tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:18.907248 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ff72bf26-7a69-48bc-a158-40dfcebdbede tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:18.908178 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ff72bf26-7a69-48bc-a158-40dfcebdbede tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:18.908914 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ff72bf26-7a69-48bc-a158-40dfcebdbede tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:19.176804 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ff72bf26-7a69-48bc-a158-40dfcebdbede tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:19.183984 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2b924986-c537-4d44-a5bb-69e3ce4d86a1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:19.185064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2b924986-c537-4d44-a5bb-69e3ce4d86a1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:19.187588 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ff72bf26-7a69-48bc-a158-40dfcebdbede tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542" status: 200 len: 1363 microversion: 2.1 time: 0.296123 Aug 19 16:38:19.188483 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 479/952] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:18 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 => generated 1363 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:19.193264 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2b924986-c537-4d44-a5bb-69e3ce4d86a1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:19.194429 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2b924986-c537-4d44-a5bb-69e3ce4d86a1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:19.195767 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2b924986-c537-4d44-a5bb-69e3ce4d86a1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:19.196737 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2b924986-c537-4d44-a5bb-69e3ce4d86a1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:19.197654 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2b924986-c537-4d44-a5bb-69e3ce4d86a1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:19.198466 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2b924986-c537-4d44-a5bb-69e3ce4d86a1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:19.413209 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2b924986-c537-4d44-a5bb-69e3ce4d86a1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:19.427885 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2b924986-c537-4d44-a5bb-69e3ce4d86a1 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1" status: 200 len: 1367 microversion: 2.1 time: 0.248050 Aug 19 16:38:19.428723 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 474/953] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:19 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:38:19.965508 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-ac0a55af-49b8-47e7-9def-0331e23975b0 req-17da4f2c-1ef5-443b-86eb-44dd4951b0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586aabe4-766f-4dbd-8f20-b172972323c1", "tag": "5b58a247-f105-47de-8142-1b37837daf56"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:38:19.976122 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-ac0a55af-49b8-47e7-9def-0331e23975b0 req-17da4f2c-1ef5-443b-86eb-44dd4951b0e0 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:19.976530 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-ac0a55af-49b8-47e7-9def-0331e23975b0 req-17da4f2c-1ef5-443b-86eb-44dd4951b0e0 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:19.976989 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-ac0a55af-49b8-47e7-9def-0331e23975b0 req-17da4f2c-1ef5-443b-86eb-44dd4951b0e0 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:19.988418 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-ac0a55af-49b8-47e7-9def-0331e23975b0 req-17da4f2c-1ef5-443b-86eb-44dd4951b0e0 service nova] Creating event network-changed:5b58a247-f105-47de-8142-1b37837daf56 for instance 586aabe4-766f-4dbd-8f20-b172972323c1 on hv-cinder-83124 Aug 19 16:38:19.993420 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-ac0a55af-49b8-47e7-9def-0331e23975b0 req-17da4f2c-1ef5-443b-86eb-44dd4951b0e0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031614 Aug 19 16:38:19.994081 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 480/954] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:20.209267 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-dad3feeb-6bd9-45b5-8981-85d150a3daa9 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:20.209885 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-dad3feeb-6bd9-45b5-8981-85d150a3daa9 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:20.216258 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dad3feeb-6bd9-45b5-8981-85d150a3daa9 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:20.217354 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dad3feeb-6bd9-45b5-8981-85d150a3daa9 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:20.218037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dad3feeb-6bd9-45b5-8981-85d150a3daa9 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:20.218601 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dad3feeb-6bd9-45b5-8981-85d150a3daa9 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:20.219061 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dad3feeb-6bd9-45b5-8981-85d150a3daa9 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:20.219489 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dad3feeb-6bd9-45b5-8981-85d150a3daa9 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:20.361893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-dad3feeb-6bd9-45b5-8981-85d150a3daa9 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:20.369550 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-dad3feeb-6bd9-45b5-8981-85d150a3daa9 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542" status: 200 len: 1363 microversion: 2.1 time: 0.164192 Aug 19 16:38:20.370314 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 475/955] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:20 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:20.453742 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-490f681a-eb1f-4ecb-ae68-00c45e297a76 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:20.455132 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-490f681a-eb1f-4ecb-ae68-00c45e297a76 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:20.461329 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-490f681a-eb1f-4ecb-ae68-00c45e297a76 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:20.461811 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-490f681a-eb1f-4ecb-ae68-00c45e297a76 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:20.462248 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-490f681a-eb1f-4ecb-ae68-00c45e297a76 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:20.462987 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-490f681a-eb1f-4ecb-ae68-00c45e297a76 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:20.463439 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-490f681a-eb1f-4ecb-ae68-00c45e297a76 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:20.463861 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-490f681a-eb1f-4ecb-ae68-00c45e297a76 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:20.605975 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-490f681a-eb1f-4ecb-ae68-00c45e297a76 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:20.614331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-490f681a-eb1f-4ecb-ae68-00c45e297a76 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1" status: 200 len: 1367 microversion: 2.1 time: 0.166212 Aug 19 16:38:20.614891 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 481/956] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:20 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:20.971277 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-82e43782-75ba-4e3f-a0a2-892e28702ed8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:38:20.971972 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-82e43782-75ba-4e3f-a0a2-892e28702ed8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:20.978046 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-82e43782-75ba-4e3f-a0a2-892e28702ed8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:20.978656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-82e43782-75ba-4e3f-a0a2-892e28702ed8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:20.979102 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-82e43782-75ba-4e3f-a0a2-892e28702ed8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:20.979804 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-82e43782-75ba-4e3f-a0a2-892e28702ed8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:20.980265 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-82e43782-75ba-4e3f-a0a2-892e28702ed8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:20.980696 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-82e43782-75ba-4e3f-a0a2-892e28702ed8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:21.005603 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.objects.instance [None req-82e43782-75ba-4e3f-a0a2-892e28702ed8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lazy-loading 'flavor' on Instance uuid 5cf04a2f-684c-4e14-8def-16324168613c {{(pid=127285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:38:21.192711 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-82e43782-75ba-4e3f-a0a2-892e28702ed8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "POST /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c/action" status: 202 len: 0 microversion: 2.20 time: 0.226058 Aug 19 16:38:21.193763 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 476/957] 10.222.0.55 () {62 vars in 1319 bytes} [Fri Aug 19 16:38:20 2022] POST /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:38:21.202985 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-07d55e12-1440-4569-ba6a-005df2d61ca0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:21.203738 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-07d55e12-1440-4569-ba6a-005df2d61ca0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:21.210545 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-07d55e12-1440-4569-ba6a-005df2d61ca0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:21.211380 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-07d55e12-1440-4569-ba6a-005df2d61ca0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:21.211914 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-07d55e12-1440-4569-ba6a-005df2d61ca0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:21.212915 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-07d55e12-1440-4569-ba6a-005df2d61ca0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:21.213647 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-07d55e12-1440-4569-ba6a-005df2d61ca0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:21.214166 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-07d55e12-1440-4569-ba6a-005df2d61ca0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:21.349521 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-07d55e12-1440-4569-ba6a-005df2d61ca0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:21.357714 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-07d55e12-1440-4569-ba6a-005df2d61ca0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:21.359193 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-07d55e12-1440-4569-ba6a-005df2d61ca0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:21.360334 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-07d55e12-1440-4569-ba6a-005df2d61ca0 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1720 microversion: 2.20 time: 0.162060 Aug 19 16:38:21.360914 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 482/958] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:21 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:21.392472 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-06245d34-1862-442d-b4f0-219c7b9cc641 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:21.393076 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-06245d34-1862-442d-b4f0-219c7b9cc641 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:21.400373 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06245d34-1862-442d-b4f0-219c7b9cc641 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:21.400890 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06245d34-1862-442d-b4f0-219c7b9cc641 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:21.401335 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06245d34-1862-442d-b4f0-219c7b9cc641 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:21.402033 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06245d34-1862-442d-b4f0-219c7b9cc641 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:21.402505 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06245d34-1862-442d-b4f0-219c7b9cc641 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:21.402919 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06245d34-1862-442d-b4f0-219c7b9cc641 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:21.601995 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-06245d34-1862-442d-b4f0-219c7b9cc641 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:21.611102 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-06245d34-1862-442d-b4f0-219c7b9cc641 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542" status: 200 len: 1363 microversion: 2.1 time: 0.224051 Aug 19 16:38:21.611673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 477/959] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:21 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:21.634447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2ca62333-b665-4807-9542-a306b0e42dea tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:21.635065 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2ca62333-b665-4807-9542-a306b0e42dea tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:21.643406 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2ca62333-b665-4807-9542-a306b0e42dea tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:21.646078 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2ca62333-b665-4807-9542-a306b0e42dea tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:21.646531 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2ca62333-b665-4807-9542-a306b0e42dea tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:21.647251 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2ca62333-b665-4807-9542-a306b0e42dea tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:21.647711 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2ca62333-b665-4807-9542-a306b0e42dea tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:21.648140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2ca62333-b665-4807-9542-a306b0e42dea tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:21.790456 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2ca62333-b665-4807-9542-a306b0e42dea tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:21.798146 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2ca62333-b665-4807-9542-a306b0e42dea tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1" status: 200 len: 1367 microversion: 2.1 time: 0.167529 Aug 19 16:38:21.798750 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 483/960] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:21 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:38:22.383372 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e09e7164-e789-4139-96a2-15af2ed99a63 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:22.383974 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e09e7164-e789-4139-96a2-15af2ed99a63 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:22.390827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e09e7164-e789-4139-96a2-15af2ed99a63 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:22.391305 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e09e7164-e789-4139-96a2-15af2ed99a63 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:22.391740 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e09e7164-e789-4139-96a2-15af2ed99a63 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:22.392418 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e09e7164-e789-4139-96a2-15af2ed99a63 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:22.392915 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e09e7164-e789-4139-96a2-15af2ed99a63 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:22.393445 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e09e7164-e789-4139-96a2-15af2ed99a63 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:22.521288 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e09e7164-e789-4139-96a2-15af2ed99a63 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:22.524803 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:22.530697 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e09e7164-e789-4139-96a2-15af2ed99a63 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:22.532196 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e09e7164-e789-4139-96a2-15af2ed99a63 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:22.533389 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e09e7164-e789-4139-96a2-15af2ed99a63 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1720 microversion: 2.20 time: 0.153958 Aug 19 16:38:22.533940 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 478/961] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:22 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:22.633467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e0b7e181-543a-40f2-9816-86c3d3b49307 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:22.634003 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-e0b7e181-543a-40f2-9816-86c3d3b49307 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:22.641899 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e0b7e181-543a-40f2-9816-86c3d3b49307 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:22.642436 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e0b7e181-543a-40f2-9816-86c3d3b49307 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:22.642874 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e0b7e181-543a-40f2-9816-86c3d3b49307 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:22.644034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e0b7e181-543a-40f2-9816-86c3d3b49307 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:22.644647 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e0b7e181-543a-40f2-9816-86c3d3b49307 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:22.645395 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e0b7e181-543a-40f2-9816-86c3d3b49307 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:22.779988 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e0b7e181-543a-40f2-9816-86c3d3b49307 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:22.787980 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e0b7e181-543a-40f2-9816-86c3d3b49307 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542" status: 200 len: 1363 microversion: 2.1 time: 0.158402 Aug 19 16:38:22.788717 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 484/962] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:22 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:22.820886 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0aeddf18-557a-45a4-8653-36b6f55f1c68 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:22.821507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-0aeddf18-557a-45a4-8653-36b6f55f1c68 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:22.829422 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0aeddf18-557a-45a4-8653-36b6f55f1c68 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:22.829980 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0aeddf18-557a-45a4-8653-36b6f55f1c68 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:22.830477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0aeddf18-557a-45a4-8653-36b6f55f1c68 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:22.831178 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0aeddf18-557a-45a4-8653-36b6f55f1c68 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:22.831641 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0aeddf18-557a-45a4-8653-36b6f55f1c68 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:22.835020 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0aeddf18-557a-45a4-8653-36b6f55f1c68 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:22.983134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-0aeddf18-557a-45a4-8653-36b6f55f1c68 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:22.991563 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-0aeddf18-557a-45a4-8653-36b6f55f1c68 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1" status: 200 len: 1367 microversion: 2.1 time: 0.176720 Aug 19 16:38:22.992490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 479/963] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:22 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:23.557457 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-80f1a064-88ae-4535-a626-784eb0bab36f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:23.558182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-80f1a064-88ae-4535-a626-784eb0bab36f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:23.564707 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-80f1a064-88ae-4535-a626-784eb0bab36f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:23.566241 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-80f1a064-88ae-4535-a626-784eb0bab36f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:23.566693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-80f1a064-88ae-4535-a626-784eb0bab36f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:23.567519 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-80f1a064-88ae-4535-a626-784eb0bab36f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:23.567841 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-80f1a064-88ae-4535-a626-784eb0bab36f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:23.568269 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-80f1a064-88ae-4535-a626-784eb0bab36f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:23.709548 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-80f1a064-88ae-4535-a626-784eb0bab36f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:23.718486 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-80f1a064-88ae-4535-a626-784eb0bab36f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:23.720004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-80f1a064-88ae-4535-a626-784eb0bab36f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:23.721183 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-80f1a064-88ae-4535-a626-784eb0bab36f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1720 microversion: 2.20 time: 0.168346 Aug 19 16:38:23.721736 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 485/964] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:23 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:23.810688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-88003793-e199-415b-948b-4d671aa657e2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:23.811557 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-88003793-e199-415b-948b-4d671aa657e2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:23.818109 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-88003793-e199-415b-948b-4d671aa657e2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:23.818606 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-88003793-e199-415b-948b-4d671aa657e2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:23.819374 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-88003793-e199-415b-948b-4d671aa657e2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:23.820289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-88003793-e199-415b-948b-4d671aa657e2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:23.820862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-88003793-e199-415b-948b-4d671aa657e2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:23.821297 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-88003793-e199-415b-948b-4d671aa657e2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:23.986564 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-88003793-e199-415b-948b-4d671aa657e2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:23.994343 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-88003793-e199-415b-948b-4d671aa657e2 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542" status: 200 len: 1363 microversion: 2.1 time: 0.188489 Aug 19 16:38:23.994993 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 480/965] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:23 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:24.011430 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e4b8d6bb-beb4-46a8-8f37-020918b50c92 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:24.012043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-e4b8d6bb-beb4-46a8-8f37-020918b50c92 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:24.018688 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e4b8d6bb-beb4-46a8-8f37-020918b50c92 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:24.019168 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e4b8d6bb-beb4-46a8-8f37-020918b50c92 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:24.019604 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e4b8d6bb-beb4-46a8-8f37-020918b50c92 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:24.020293 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e4b8d6bb-beb4-46a8-8f37-020918b50c92 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:24.020742 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e4b8d6bb-beb4-46a8-8f37-020918b50c92 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:24.021188 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e4b8d6bb-beb4-46a8-8f37-020918b50c92 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:24.172608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e4b8d6bb-beb4-46a8-8f37-020918b50c92 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:24.180257 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e4b8d6bb-beb4-46a8-8f37-020918b50c92 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1" status: 200 len: 1367 microversion: 2.1 time: 0.172720 Aug 19 16:38:24.180928 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 486/966] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:24 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:24.745421 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-9358c539-7441-4b2c-84c5-9dd9095bdc52 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:24.746315 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-9358c539-7441-4b2c-84c5-9dd9095bdc52 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:24.752935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9358c539-7441-4b2c-84c5-9dd9095bdc52 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:24.753666 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9358c539-7441-4b2c-84c5-9dd9095bdc52 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:24.754250 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9358c539-7441-4b2c-84c5-9dd9095bdc52 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:24.755208 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9358c539-7441-4b2c-84c5-9dd9095bdc52 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:24.755674 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9358c539-7441-4b2c-84c5-9dd9095bdc52 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:24.756103 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-9358c539-7441-4b2c-84c5-9dd9095bdc52 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:24.777334 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-d65d16c4-0809-44c6-aef2-c16ccea4e324 req-720b34dd-758d-4c25-9269-4fb912a80b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99fc027-bd6e-4ba2-9beb-d7277f387542", "name": "network-vif-plugged", "status": "completed", "tag": "1e7ac66a-3d3d-4107-909c-ab6a1732405a"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:38:24.803046 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-d65d16c4-0809-44c6-aef2-c16ccea4e324 req-720b34dd-758d-4c25-9269-4fb912a80b52 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:24.803773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-d65d16c4-0809-44c6-aef2-c16ccea4e324 req-720b34dd-758d-4c25-9269-4fb912a80b52 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:24.804366 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-d65d16c4-0809-44c6-aef2-c16ccea4e324 req-720b34dd-758d-4c25-9269-4fb912a80b52 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:24.832741 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-d65d16c4-0809-44c6-aef2-c16ccea4e324 req-720b34dd-758d-4c25-9269-4fb912a80b52 service nova] Creating event network-vif-plugged:1e7ac66a-3d3d-4107-909c-ab6a1732405a for instance d99fc027-bd6e-4ba2-9beb-d7277f387542 on hv-cinder-83124 Aug 19 16:38:24.838358 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-d65d16c4-0809-44c6-aef2-c16ccea4e324 req-720b34dd-758d-4c25-9269-4fb912a80b52 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067234 Aug 19 16:38:24.839786 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 487/967] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:24.896720 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-9358c539-7441-4b2c-84c5-9dd9095bdc52 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:24.908419 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-9358c539-7441-4b2c-84c5-9dd9095bdc52 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:24.910595 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-9358c539-7441-4b2c-84c5-9dd9095bdc52 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:24.912379 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-9358c539-7441-4b2c-84c5-9dd9095bdc52 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1720 microversion: 2.20 time: 0.171516 Aug 19 16:38:24.914037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 481/968] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:24 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:25.025676 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c6446035-b330-450e-8c6e-ad24c6937a66 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:25.026926 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-c6446035-b330-450e-8c6e-ad24c6937a66 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:25.035219 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c6446035-b330-450e-8c6e-ad24c6937a66 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:25.035903 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c6446035-b330-450e-8c6e-ad24c6937a66 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:25.036339 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c6446035-b330-450e-8c6e-ad24c6937a66 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:25.037074 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c6446035-b330-450e-8c6e-ad24c6937a66 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:25.037566 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c6446035-b330-450e-8c6e-ad24c6937a66 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:25.037981 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c6446035-b330-450e-8c6e-ad24c6937a66 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:25.182465 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c6446035-b330-450e-8c6e-ad24c6937a66 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:25.195262 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c6446035-b330-450e-8c6e-ad24c6937a66 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542" status: 200 len: 1363 microversion: 2.1 time: 0.182920 Aug 19 16:38:25.206314 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 488/969] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:25 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:25.211388 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-06a978fd-a638-436b-aa5f-7e2744d7b011 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:25.212019 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-06a978fd-a638-436b-aa5f-7e2744d7b011 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:25.220110 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06a978fd-a638-436b-aa5f-7e2744d7b011 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:25.221201 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06a978fd-a638-436b-aa5f-7e2744d7b011 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:25.221723 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06a978fd-a638-436b-aa5f-7e2744d7b011 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:25.222908 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06a978fd-a638-436b-aa5f-7e2744d7b011 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:25.223379 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06a978fd-a638-436b-aa5f-7e2744d7b011 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:25.223992 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-06a978fd-a638-436b-aa5f-7e2744d7b011 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:25.370038 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-06a978fd-a638-436b-aa5f-7e2744d7b011 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:25.377952 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-06a978fd-a638-436b-aa5f-7e2744d7b011 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1" status: 200 len: 1367 microversion: 2.1 time: 0.179319 Aug 19 16:38:25.378510 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 482/970] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:25 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:38:25.938402 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c55f66d9-03ed-4c5f-a2a4-0ccc9d92baa2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:25.939281 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-c55f66d9-03ed-4c5f-a2a4-0ccc9d92baa2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:25.946268 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c55f66d9-03ed-4c5f-a2a4-0ccc9d92baa2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:25.946899 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c55f66d9-03ed-4c5f-a2a4-0ccc9d92baa2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:25.947473 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c55f66d9-03ed-4c5f-a2a4-0ccc9d92baa2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:25.948312 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c55f66d9-03ed-4c5f-a2a4-0ccc9d92baa2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:25.948926 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c55f66d9-03ed-4c5f-a2a4-0ccc9d92baa2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:25.949421 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c55f66d9-03ed-4c5f-a2a4-0ccc9d92baa2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:25.969786 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=100 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:26.086312 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c55f66d9-03ed-4c5f-a2a4-0ccc9d92baa2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:26.095269 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c55f66d9-03ed-4c5f-a2a4-0ccc9d92baa2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:26.096778 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c55f66d9-03ed-4c5f-a2a4-0ccc9d92baa2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:26.097943 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c55f66d9-03ed-4c5f-a2a4-0ccc9d92baa2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1720 microversion: 2.20 time: 0.165310 Aug 19 16:38:26.098492 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 489/971] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:25 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:26.218631 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b7d4eb90-783f-4f4c-a6bd-e45ef358db60 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:26.219440 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b7d4eb90-783f-4f4c-a6bd-e45ef358db60 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:26.226238 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b7d4eb90-783f-4f4c-a6bd-e45ef358db60 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:26.226723 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b7d4eb90-783f-4f4c-a6bd-e45ef358db60 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:26.227161 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b7d4eb90-783f-4f4c-a6bd-e45ef358db60 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:26.227846 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b7d4eb90-783f-4f4c-a6bd-e45ef358db60 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:26.228302 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b7d4eb90-783f-4f4c-a6bd-e45ef358db60 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:26.228719 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b7d4eb90-783f-4f4c-a6bd-e45ef358db60 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:26.367098 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b7d4eb90-783f-4f4c-a6bd-e45ef358db60 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:26.375828 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b7d4eb90-783f-4f4c-a6bd-e45ef358db60 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542" status: 200 len: 1363 microversion: 2.1 time: 0.161735 Aug 19 16:38:26.376400 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 483/972] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:26 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:26.398743 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-07fc1141-e6dd-4ea0-8ab0-e188d0501115 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:26.399348 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-07fc1141-e6dd-4ea0-8ab0-e188d0501115 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:26.406238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-07fc1141-e6dd-4ea0-8ab0-e188d0501115 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:26.406712 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-07fc1141-e6dd-4ea0-8ab0-e188d0501115 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:26.407140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-07fc1141-e6dd-4ea0-8ab0-e188d0501115 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:26.407820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-07fc1141-e6dd-4ea0-8ab0-e188d0501115 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:26.408265 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-07fc1141-e6dd-4ea0-8ab0-e188d0501115 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:26.408677 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-07fc1141-e6dd-4ea0-8ab0-e188d0501115 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:26.546313 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-07fc1141-e6dd-4ea0-8ab0-e188d0501115 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:26.554727 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-07fc1141-e6dd-4ea0-8ab0-e188d0501115 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1" status: 200 len: 1367 microversion: 2.1 time: 0.159804 Aug 19 16:38:26.555733 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 490/973] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:26 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:26.854768 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-2de10b53-1549-46a3-a176-9fa2420b2923 req-a0102e96-fbda-4b22-8930-a55f50a4e70d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586aabe4-766f-4dbd-8f20-b172972323c1", "name": "network-vif-plugged", "status": "completed", "tag": "5b58a247-f105-47de-8142-1b37837daf56"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:38:26.859919 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=4 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:26.860800 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=16 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:26.867281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-2de10b53-1549-46a3-a176-9fa2420b2923 req-a0102e96-fbda-4b22-8930-a55f50a4e70d service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:26.867916 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-2de10b53-1549-46a3-a176-9fa2420b2923 req-a0102e96-fbda-4b22-8930-a55f50a4e70d service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:26.868464 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-2de10b53-1549-46a3-a176-9fa2420b2923 req-a0102e96-fbda-4b22-8930-a55f50a4e70d service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:26.882181 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-2de10b53-1549-46a3-a176-9fa2420b2923 req-a0102e96-fbda-4b22-8930-a55f50a4e70d service nova] Creating event network-vif-plugged:5b58a247-f105-47de-8142-1b37837daf56 for instance 586aabe4-766f-4dbd-8f20-b172972323c1 on hv-cinder-83124 Aug 19 16:38:26.887464 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-2de10b53-1549-46a3-a176-9fa2420b2923 req-a0102e96-fbda-4b22-8930-a55f50a4e70d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036400 Aug 19 16:38:26.888897 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 484/974] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:27.122069 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-dd7a9a97-9674-49d0-a51b-ceba53c95c41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:27.122966 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-dd7a9a97-9674-49d0-a51b-ceba53c95c41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:27.131852 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=8 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:27.134691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd7a9a97-9674-49d0-a51b-ceba53c95c41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:27.135385 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd7a9a97-9674-49d0-a51b-ceba53c95c41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:27.135816 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd7a9a97-9674-49d0-a51b-ceba53c95c41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:27.136715 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd7a9a97-9674-49d0-a51b-ceba53c95c41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:27.137408 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd7a9a97-9674-49d0-a51b-ceba53c95c41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:27.137814 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dd7a9a97-9674-49d0-a51b-ceba53c95c41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:27.397401 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-dd788af9-0c70-4ca7-a1f6-d00841111a80 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:27.398091 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-dd788af9-0c70-4ca7-a1f6-d00841111a80 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:27.405400 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dd788af9-0c70-4ca7-a1f6-d00841111a80 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:27.405879 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dd788af9-0c70-4ca7-a1f6-d00841111a80 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:27.406311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dd788af9-0c70-4ca7-a1f6-d00841111a80 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:27.407003 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dd788af9-0c70-4ca7-a1f6-d00841111a80 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:27.407450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dd788af9-0c70-4ca7-a1f6-d00841111a80 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:27.407868 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dd788af9-0c70-4ca7-a1f6-d00841111a80 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:27.446939 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-dd7a9a97-9674-49d0-a51b-ceba53c95c41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:27.456863 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-dd7a9a97-9674-49d0-a51b-ceba53c95c41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:27.459132 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-dd7a9a97-9674-49d0-a51b-ceba53c95c41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:27.460855 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-dd7a9a97-9674-49d0-a51b-ceba53c95c41 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1720 microversion: 2.20 time: 0.343812 Aug 19 16:38:27.461905 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 491/975] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:27 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1720 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:27.563749 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-dd788af9-0c70-4ca7-a1f6-d00841111a80 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:27.571718 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-dd788af9-0c70-4ca7-a1f6-d00841111a80 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542" status: 200 len: 1550 microversion: 2.1 time: 0.178456 Aug 19 16:38:27.572280 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 485/976] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:27 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 => generated 1550 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:38:27.578260 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-16a1b40f-1494-4102-b9f7-51b6a0ea58e5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:27.578832 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-16a1b40f-1494-4102-b9f7-51b6a0ea58e5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:27.585936 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-16a1b40f-1494-4102-b9f7-51b6a0ea58e5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:27.586424 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-16a1b40f-1494-4102-b9f7-51b6a0ea58e5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:27.586860 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-16a1b40f-1494-4102-b9f7-51b6a0ea58e5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:27.587548 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-16a1b40f-1494-4102-b9f7-51b6a0ea58e5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:27.588001 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-16a1b40f-1494-4102-b9f7-51b6a0ea58e5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:27.588604 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-16a1b40f-1494-4102-b9f7-51b6a0ea58e5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:27.594255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-af23baa0-a5ab-4f20-b2b2-5699c0a5c0cd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:27.594579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-af23baa0-a5ab-4f20-b2b2-5699c0a5c0cd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:27.597047 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:INSERT=7 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:27.602724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-af23baa0-a5ab-4f20-b2b2-5699c0a5c0cd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:27.603219 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-af23baa0-a5ab-4f20-b2b2-5699c0a5c0cd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:27.603658 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-af23baa0-a5ab-4f20-b2b2-5699c0a5c0cd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:27.604363 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-af23baa0-a5ab-4f20-b2b2-5699c0a5c0cd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:27.604847 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-af23baa0-a5ab-4f20-b2b2-5699c0a5c0cd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:27.605283 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-af23baa0-a5ab-4f20-b2b2-5699c0a5c0cd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:27.686852 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-af23baa0-a5ab-4f20-b2b2-5699c0a5c0cd tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097200 Aug 19 16:38:27.687737 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 486/977] 10.222.0.55 () {58 vars in 1275 bytes} [Fri Aug 19 16:38:27 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:27.744340 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-16a1b40f-1494-4102-b9f7-51b6a0ea58e5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:27.755997 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-16a1b40f-1494-4102-b9f7-51b6a0ea58e5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1" status: 200 len: 1367 microversion: 2.1 time: 0.181943 Aug 19 16:38:27.756716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 492/978] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:27 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:27.793097 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f8933e61-4f48-46f0-8c38-5c92c46cf8b8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-886385740"}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:38:27.793646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f8933e61-4f48-46f0-8c38-5c92c46cf8b8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:27.801632 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f8933e61-4f48-46f0-8c38-5c92c46cf8b8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:27.802232 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f8933e61-4f48-46f0-8c38-5c92c46cf8b8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:27.802731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f8933e61-4f48-46f0-8c38-5c92c46cf8b8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:27.803628 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f8933e61-4f48-46f0-8c38-5c92c46cf8b8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:27.804210 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f8933e61-4f48-46f0-8c38-5c92c46cf8b8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:27.804815 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f8933e61-4f48-46f0-8c38-5c92c46cf8b8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:28.033743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.network.security_group_api [None req-f8933e61-4f48-46f0-8c38-5c92c46cf8b8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Removing security group 4162fe98-9f09-4018-8583-028120981944 from port 498a3f32-b577-44b6-8701-625d4a4962ec Aug 19 16:38:28.487783 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-fd9704c0-bd6a-4d58-a849-071e938df564 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:28.488337 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-fd9704c0-bd6a-4d58-a849-071e938df564 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:28.495768 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fd9704c0-bd6a-4d58-a849-071e938df564 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:28.496253 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fd9704c0-bd6a-4d58-a849-071e938df564 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:28.497111 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fd9704c0-bd6a-4d58-a849-071e938df564 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:28.499058 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fd9704c0-bd6a-4d58-a849-071e938df564 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:28.499727 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fd9704c0-bd6a-4d58-a849-071e938df564 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:28.500186 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fd9704c0-bd6a-4d58-a849-071e938df564 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:28.666829 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-fd9704c0-bd6a-4d58-a849-071e938df564 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:28.675949 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-fd9704c0-bd6a-4d58-a849-071e938df564 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:28.677529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-fd9704c0-bd6a-4d58-a849-071e938df564 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:28.678757 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-fd9704c0-bd6a-4d58-a849-071e938df564 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1720 microversion: 2.20 time: 0.195552 Aug 19 16:38:28.679534 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 493/979] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:28 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1720 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:28.778079 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-bf875a1e-5614-4560-9532-0b013ff70d05 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:28.778649 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-bf875a1e-5614-4560-9532-0b013ff70d05 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:28.803309 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bf875a1e-5614-4560-9532-0b013ff70d05 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:28.804071 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bf875a1e-5614-4560-9532-0b013ff70d05 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:28.804514 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bf875a1e-5614-4560-9532-0b013ff70d05 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:28.805318 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bf875a1e-5614-4560-9532-0b013ff70d05 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:28.805948 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bf875a1e-5614-4560-9532-0b013ff70d05 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:28.806380 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bf875a1e-5614-4560-9532-0b013ff70d05 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:28.909546 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f8933e61-4f48-46f0-8c38-5c92c46cf8b8 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "POST /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/action" status: 202 len: 0 microversion: 2.1 time: 1.119080 Aug 19 16:38:28.910287 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 487/980] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Aug 19 16:38:27 2022] POST /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/action => generated 0 bytes in 1122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:38:28.959513 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-34229d01-f9f2-4d35-9f42-f4fe1997ac0d req-624d1579-4fba-4659-b6e0-bb33bf3d4b66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4034526-7330-4541-a2cb-d646a572d9d8", "tag": "498a3f32-b577-44b6-8701-625d4a4962ec"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:38:28.969773 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-34229d01-f9f2-4d35-9f42-f4fe1997ac0d req-624d1579-4fba-4659-b6e0-bb33bf3d4b66 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:28.970537 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-34229d01-f9f2-4d35-9f42-f4fe1997ac0d req-624d1579-4fba-4659-b6e0-bb33bf3d4b66 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:28.971287 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-34229d01-f9f2-4d35-9f42-f4fe1997ac0d req-624d1579-4fba-4659-b6e0-bb33bf3d4b66 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:28.984031 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-34229d01-f9f2-4d35-9f42-f4fe1997ac0d req-624d1579-4fba-4659-b6e0-bb33bf3d4b66 service nova] Creating event network-changed:498a3f32-b577-44b6-8701-625d4a4962ec for instance d4034526-7330-4541-a2cb-d646a572d9d8 on hv-cinder-83124 Aug 19 16:38:28.990423 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-34229d01-f9f2-4d35-9f42-f4fe1997ac0d req-624d1579-4fba-4659-b6e0-bb33bf3d4b66 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034505 Aug 19 16:38:28.991651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 488/981] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:38:29.016927 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-bf875a1e-5614-4560-9532-0b013ff70d05 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:29.027722 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-bf875a1e-5614-4560-9532-0b013ff70d05 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1" status: 200 len: 1367 microversion: 2.1 time: 0.253725 Aug 19 16:38:29.029612 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 494/982] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:28 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:38:29.711950 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2587f61b-cd60-4f26-8e20-9d2d869092ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:29.712795 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2587f61b-cd60-4f26-8e20-9d2d869092ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:29.721582 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2587f61b-cd60-4f26-8e20-9d2d869092ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:29.722089 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2587f61b-cd60-4f26-8e20-9d2d869092ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:29.722712 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2587f61b-cd60-4f26-8e20-9d2d869092ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:29.723572 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2587f61b-cd60-4f26-8e20-9d2d869092ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:29.724573 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2587f61b-cd60-4f26-8e20-9d2d869092ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:29.725188 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2587f61b-cd60-4f26-8e20-9d2d869092ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:30.049998 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f86616b1-b477-40b3-8a47-a44a51676c6e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:30.050842 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f86616b1-b477-40b3-8a47-a44a51676c6e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:30.058336 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f86616b1-b477-40b3-8a47-a44a51676c6e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:30.058921 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f86616b1-b477-40b3-8a47-a44a51676c6e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:30.059434 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f86616b1-b477-40b3-8a47-a44a51676c6e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:30.061284 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f86616b1-b477-40b3-8a47-a44a51676c6e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:30.061754 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f86616b1-b477-40b3-8a47-a44a51676c6e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:30.062635 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f86616b1-b477-40b3-8a47-a44a51676c6e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:30.118291 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2587f61b-cd60-4f26-8e20-9d2d869092ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:30.130058 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2587f61b-cd60-4f26-8e20-9d2d869092ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:30.131992 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2587f61b-cd60-4f26-8e20-9d2d869092ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:30.133512 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2587f61b-cd60-4f26-8e20-9d2d869092ea tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1720 microversion: 2.20 time: 0.429094 Aug 19 16:38:30.134318 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 489/983] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:29 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1720 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:30.240143 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f86616b1-b477-40b3-8a47-a44a51676c6e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:30.250550 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f86616b1-b477-40b3-8a47-a44a51676c6e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1" status: 200 len: 1558 microversion: 2.1 time: 0.204823 Aug 19 16:38:30.251261 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 495/984] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:30 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 => generated 1558 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:30.271810 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0b28fa6e-c5bf-4eef-aee8-a68375d6559c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:30.272909 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-0b28fa6e-c5bf-4eef-aee8-a68375d6559c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:30.279485 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0b28fa6e-c5bf-4eef-aee8-a68375d6559c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:30.279976 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0b28fa6e-c5bf-4eef-aee8-a68375d6559c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:30.280409 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0b28fa6e-c5bf-4eef-aee8-a68375d6559c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:30.281145 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0b28fa6e-c5bf-4eef-aee8-a68375d6559c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:30.281605 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0b28fa6e-c5bf-4eef-aee8-a68375d6559c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:30.282055 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0b28fa6e-c5bf-4eef-aee8-a68375d6559c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:30.508496 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-0b28fa6e-c5bf-4eef-aee8-a68375d6559c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.240648 Aug 19 16:38:30.509311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 490/985] 10.222.0.55 () {58 vars in 1275 bytes} [Fri Aug 19 16:38:30 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-interface => generated 285 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:30.783265 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-13486983-4554-447d-8e52-2c866774597d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:30.783763 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-13486983-4554-447d-8e52-2c866774597d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:30.789550 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-13486983-4554-447d-8e52-2c866774597d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:30.790034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-13486983-4554-447d-8e52-2c866774597d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:30.790467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-13486983-4554-447d-8e52-2c866774597d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:30.791158 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-13486983-4554-447d-8e52-2c866774597d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:30.791604 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-13486983-4554-447d-8e52-2c866774597d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:30.792225 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-13486983-4554-447d-8e52-2c866774597d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:30.878522 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.objects.instance [None req-13486983-4554-447d-8e52-2c866774597d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lazy-loading 'services' on Instance uuid d4034526-7330-4541-a2cb-d646a572d9d8 {{(pid=127284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:38:30.965336 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-13486983-4554-447d-8e52-2c866774597d tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/os-volume_attachments/62ae547b-ada4-4583-9cb2-fc14c5be98c0" status: 202 len: 0 microversion: 2.1 time: 0.186383 Aug 19 16:38:30.966888 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 496/986] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Aug 19 16:38:30 2022] DELETE /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/os-volume_attachments/62ae547b-ada4-4583-9cb2-fc14c5be98c0 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:38:30.977265 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-69cc4127-358c-46ca-8c2d-60089ef0f5fc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:30.980412 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-69cc4127-358c-46ca-8c2d-60089ef0f5fc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:30.988031 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-69cc4127-358c-46ca-8c2d-60089ef0f5fc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:30.988708 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-69cc4127-358c-46ca-8c2d-60089ef0f5fc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:30.989339 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-69cc4127-358c-46ca-8c2d-60089ef0f5fc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:30.990249 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-69cc4127-358c-46ca-8c2d-60089ef0f5fc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:30.990857 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-69cc4127-358c-46ca-8c2d-60089ef0f5fc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:30.991449 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-69cc4127-358c-46ca-8c2d-60089ef0f5fc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:31.007436 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-f563ec80-7f44-4419-8e05-77d959b76c77 req-7af1a9a2-b749-4f89-a52a-ef9f580df525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99fc027-bd6e-4ba2-9beb-d7277f387542", "tag": "1e7ac66a-3d3d-4107-909c-ab6a1732405a"}, {"name": "network-changed", "server_uuid": "d4034526-7330-4541-a2cb-d646a572d9d8", "tag": "498a3f32-b577-44b6-8701-625d4a4962ec"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:38:31.018856 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-f563ec80-7f44-4419-8e05-77d959b76c77 req-7af1a9a2-b749-4f89-a52a-ef9f580df525 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:31.019701 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-f563ec80-7f44-4419-8e05-77d959b76c77 req-7af1a9a2-b749-4f89-a52a-ef9f580df525 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:31.020518 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-f563ec80-7f44-4419-8e05-77d959b76c77 req-7af1a9a2-b749-4f89-a52a-ef9f580df525 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:31.024777 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-69cc4127-358c-46ca-8c2d-60089ef0f5fc tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053458 Aug 19 16:38:31.025599 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 491/987] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:38:30 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:31.034919 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-f563ec80-7f44-4419-8e05-77d959b76c77 req-7af1a9a2-b749-4f89-a52a-ef9f580df525 service nova] Creating event network-changed:1e7ac66a-3d3d-4107-909c-ab6a1732405a for instance d99fc027-bd6e-4ba2-9beb-d7277f387542 on hv-cinder-83124 Aug 19 16:38:31.035441 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-f563ec80-7f44-4419-8e05-77d959b76c77 req-7af1a9a2-b749-4f89-a52a-ef9f580df525 service nova] Creating event network-changed:498a3f32-b577-44b6-8701-625d4a4962ec for instance d4034526-7330-4541-a2cb-d646a572d9d8 on hv-cinder-83124 Aug 19 16:38:31.042597 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-f563ec80-7f44-4419-8e05-77d959b76c77 req-7af1a9a2-b749-4f89-a52a-ef9f580df525 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039097 Aug 19 16:38:31.043199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 497/988] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:38:31.159766 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c7765e05-5f53-4ff7-bf6e-79f4a12b6c3f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:31.160440 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c7765e05-5f53-4ff7-bf6e-79f4a12b6c3f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:31.167204 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c7765e05-5f53-4ff7-bf6e-79f4a12b6c3f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:31.167767 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c7765e05-5f53-4ff7-bf6e-79f4a12b6c3f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:31.168418 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c7765e05-5f53-4ff7-bf6e-79f4a12b6c3f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:31.169749 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c7765e05-5f53-4ff7-bf6e-79f4a12b6c3f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:31.170460 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c7765e05-5f53-4ff7-bf6e-79f4a12b6c3f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:31.172277 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c7765e05-5f53-4ff7-bf6e-79f4a12b6c3f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:31.407545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c7765e05-5f53-4ff7-bf6e-79f4a12b6c3f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:31.419436 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c7765e05-5f53-4ff7-bf6e-79f4a12b6c3f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:31.421971 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c7765e05-5f53-4ff7-bf6e-79f4a12b6c3f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:31.423339 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c7765e05-5f53-4ff7-bf6e-79f4a12b6c3f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1720 microversion: 2.20 time: 0.268012 Aug 19 16:38:31.424359 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 492/989] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:31 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1720 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:31.567095 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-68f7e4e8-db3f-4527-9d16-35038afda9d5 req-f564c3f5-c299-4135-b12c-9cb6a54fd281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586aabe4-766f-4dbd-8f20-b172972323c1", "tag": "5b58a247-f105-47de-8142-1b37837daf56"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:38:31.572426 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:31.579235 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-68f7e4e8-db3f-4527-9d16-35038afda9d5 req-f564c3f5-c299-4135-b12c-9cb6a54fd281 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:31.580210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-68f7e4e8-db3f-4527-9d16-35038afda9d5 req-f564c3f5-c299-4135-b12c-9cb6a54fd281 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:31.580845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-68f7e4e8-db3f-4527-9d16-35038afda9d5 req-f564c3f5-c299-4135-b12c-9cb6a54fd281 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:31.599955 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-68f7e4e8-db3f-4527-9d16-35038afda9d5 req-f564c3f5-c299-4135-b12c-9cb6a54fd281 service nova] Creating event network-changed:5b58a247-f105-47de-8142-1b37837daf56 for instance 586aabe4-766f-4dbd-8f20-b172972323c1 on hv-cinder-83124 Aug 19 16:38:31.605127 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-68f7e4e8-db3f-4527-9d16-35038afda9d5 req-f564c3f5-c299-4135-b12c-9cb6a54fd281 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042675 Aug 19 16:38:31.605728 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 498/990] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:32.038615 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a0d79a05-79f7-4372-93af-65d83bfee8f9 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:32.040937 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a0d79a05-79f7-4372-93af-65d83bfee8f9 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:32.047360 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a0d79a05-79f7-4372-93af-65d83bfee8f9 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:32.047950 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a0d79a05-79f7-4372-93af-65d83bfee8f9 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:32.048460 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a0d79a05-79f7-4372-93af-65d83bfee8f9 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:32.049274 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a0d79a05-79f7-4372-93af-65d83bfee8f9 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:32.049799 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a0d79a05-79f7-4372-93af-65d83bfee8f9 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:32.050294 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a0d79a05-79f7-4372-93af-65d83bfee8f9 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:32.079532 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a0d79a05-79f7-4372-93af-65d83bfee8f9 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044852 Aug 19 16:38:32.080370 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 493/991] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:38:32 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:32.446829 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-134b901d-99f6-476b-840e-fbdb3bcf8d37 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:32.447501 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-134b901d-99f6-476b-840e-fbdb3bcf8d37 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:32.454414 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-134b901d-99f6-476b-840e-fbdb3bcf8d37 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:32.454897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-134b901d-99f6-476b-840e-fbdb3bcf8d37 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:32.455329 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-134b901d-99f6-476b-840e-fbdb3bcf8d37 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:32.456020 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-134b901d-99f6-476b-840e-fbdb3bcf8d37 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:32.456466 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-134b901d-99f6-476b-840e-fbdb3bcf8d37 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:32.456912 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-134b901d-99f6-476b-840e-fbdb3bcf8d37 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:32.600948 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-134b901d-99f6-476b-840e-fbdb3bcf8d37 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:32.609567 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-134b901d-99f6-476b-840e-fbdb3bcf8d37 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:32.611261 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-134b901d-99f6-476b-840e-fbdb3bcf8d37 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:32.612420 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-134b901d-99f6-476b-840e-fbdb3bcf8d37 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1720 microversion: 2.20 time: 0.170375 Aug 19 16:38:32.612998 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 499/992] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:32 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:33.091853 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-63870588-bf23-4eb2-8d65-00205a544f28 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:33.094214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-63870588-bf23-4eb2-8d65-00205a544f28 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:33.100181 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-63870588-bf23-4eb2-8d65-00205a544f28 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:33.100665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-63870588-bf23-4eb2-8d65-00205a544f28 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:33.101127 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-63870588-bf23-4eb2-8d65-00205a544f28 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:33.101811 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-63870588-bf23-4eb2-8d65-00205a544f28 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:33.102259 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-63870588-bf23-4eb2-8d65-00205a544f28 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:33.102677 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-63870588-bf23-4eb2-8d65-00205a544f28 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:33.131995 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-63870588-bf23-4eb2-8d65-00205a544f28 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044166 Aug 19 16:38:33.132542 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 494/993] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:38:33 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:33.636001 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-8dad8637-29ee-4512-8381-feeb4aa155f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:33.636525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-8dad8637-29ee-4512-8381-feeb4aa155f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:33.644057 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8dad8637-29ee-4512-8381-feeb4aa155f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:33.644531 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8dad8637-29ee-4512-8381-feeb4aa155f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:33.644985 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8dad8637-29ee-4512-8381-feeb4aa155f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:33.645670 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8dad8637-29ee-4512-8381-feeb4aa155f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:33.646111 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8dad8637-29ee-4512-8381-feeb4aa155f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:33.646526 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-8dad8637-29ee-4512-8381-feeb4aa155f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:33.775141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8dad8637-29ee-4512-8381-feeb4aa155f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:33.783868 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8dad8637-29ee-4512-8381-feeb4aa155f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:33.785357 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-8dad8637-29ee-4512-8381-feeb4aa155f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:33.786498 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-8dad8637-29ee-4512-8381-feeb4aa155f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1720 microversion: 2.20 time: 0.154486 Aug 19 16:38:33.787049 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 500/994] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:33 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:34.144157 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d015d40e-f821-4b2a-8a96-39477f8d46ea tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:34.146319 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d015d40e-f821-4b2a-8a96-39477f8d46ea tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:34.156310 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d015d40e-f821-4b2a-8a96-39477f8d46ea tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:34.157281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d015d40e-f821-4b2a-8a96-39477f8d46ea tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:34.157903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d015d40e-f821-4b2a-8a96-39477f8d46ea tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:34.159221 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d015d40e-f821-4b2a-8a96-39477f8d46ea tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:34.160053 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d015d40e-f821-4b2a-8a96-39477f8d46ea tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:34.160829 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d015d40e-f821-4b2a-8a96-39477f8d46ea tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:34.208423 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d015d40e-f821-4b2a-8a96-39477f8d46ea tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068080 Aug 19 16:38:34.209490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 495/995] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:38:34 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:34.809199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1f4ca9ad-f9e0-4bf3-959b-553bbdf0175c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:34.810306 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1f4ca9ad-f9e0-4bf3-959b-553bbdf0175c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:34.816772 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1f4ca9ad-f9e0-4bf3-959b-553bbdf0175c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:34.817280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1f4ca9ad-f9e0-4bf3-959b-553bbdf0175c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:34.817717 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1f4ca9ad-f9e0-4bf3-959b-553bbdf0175c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:34.818672 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1f4ca9ad-f9e0-4bf3-959b-553bbdf0175c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:34.819129 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1f4ca9ad-f9e0-4bf3-959b-553bbdf0175c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:34.819551 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1f4ca9ad-f9e0-4bf3-959b-553bbdf0175c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:34.949108 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1f4ca9ad-f9e0-4bf3-959b-553bbdf0175c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:34.958016 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1f4ca9ad-f9e0-4bf3-959b-553bbdf0175c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:34.959487 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1f4ca9ad-f9e0-4bf3-959b-553bbdf0175c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:34.960625 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1f4ca9ad-f9e0-4bf3-959b-553bbdf0175c tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1720 microversion: 2.20 time: 0.155516 Aug 19 16:38:34.961211 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 501/996] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:34 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:35.221953 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c003e3ae-5251-4c0a-b732-59d2b8909091 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:35.224067 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c003e3ae-5251-4c0a-b732-59d2b8909091 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:35.230504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c003e3ae-5251-4c0a-b732-59d2b8909091 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:35.230988 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c003e3ae-5251-4c0a-b732-59d2b8909091 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:35.232074 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c003e3ae-5251-4c0a-b732-59d2b8909091 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:35.233054 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c003e3ae-5251-4c0a-b732-59d2b8909091 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:35.233517 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c003e3ae-5251-4c0a-b732-59d2b8909091 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:35.233949 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c003e3ae-5251-4c0a-b732-59d2b8909091 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:35.263326 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c003e3ae-5251-4c0a-b732-59d2b8909091 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045033 Aug 19 16:38:35.264188 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 496/997] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:38:35 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 16:38:35.274347 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d44acaad-c2d6-4837-9186-de82080acaec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:35.274837 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d44acaad-c2d6-4837-9186-de82080acaec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:35.281111 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d44acaad-c2d6-4837-9186-de82080acaec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:35.281664 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d44acaad-c2d6-4837-9186-de82080acaec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:35.282160 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d44acaad-c2d6-4837-9186-de82080acaec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:35.282913 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d44acaad-c2d6-4837-9186-de82080acaec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:35.283393 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d44acaad-c2d6-4837-9186-de82080acaec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:35.283813 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d44acaad-c2d6-4837-9186-de82080acaec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:35.359702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-d44acaad-c2d6-4837-9186-de82080acaec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] HTTP exception thrown: Instance d4034526-7330-4541-a2cb-d646a572d9d8 is not attached to volume 62ae547b-ada4-4583-9cb2-fc14c5be98c0 Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d44acaad-c2d6-4837-9186-de82080acaec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Request method failure captured: Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: DELETE /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/os-volume_attachments/62ae547b-ada4-4583-9cb2-fc14c5be98c0 HTTP/1.1 Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7u3WbDmOd3hx3peZN23J3WZyUNYhpRBqvgmxiUp1R-GqwU0cHkjMHoNpSOowelgmdiGl5BVZcPCjfUUu1FDVQt2kjwYzuycDRQykRgl4XV7ju7Zo-Jy_cV9Y7YkIwLaELTZFe8vH4h2hNRK6yr7Frar7LdtpxmZGRLtQnrX49liK9Q Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: a41afd08d1324396940e3acaf49a34b3 Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-TestMinimumBasicScenario-2010189058 Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:38:35.362280 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:38:35.363861 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a41afd08d1324396940e3acaf49a34b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a41afd08d1324396940e3acaf49a34b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a41afd08d1324396940e3acaf49a34b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a41afd08d1324396940e3acaf49a34b3"}]}] Aug 19 16:38:35.363861 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-TestMinimumBasicScenario-2010189058 Aug 19 16:38:35.363861 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: a41afd08d1324396940e3acaf49a34b3 Aug 19 16:38:35.363861 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2010189058 Aug 19 16:38:35.363861 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-TestMinimumBasicScenario-2010189058-project Aug 19 16:38:35.363861 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:38:35.363861 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:38:35.363861 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: cf1371337c03435faa5f1db60168cfbe Aug 19 16:38:35.363861 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-TestMinimumBasicScenario-2010189058-project Aug 19 16:38:35.363861 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:38:35.363861 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance d4034526-7330-4541-a2cb-d646a572d9d8 is not attached to volume 62ae547b-ada4-4583-9cb2-fc14c5be98c0 Aug 19 16:38:35.364685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'server_id': 'd4034526-7330-4541-a2cb-d646a572d9d8', 'id': '62ae547b-ada4-4583-9cb2-fc14c5be98c0'} Aug 19 16:38:35.364685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:38:35.364685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:38:35.364685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 19 16:38:35.364685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 19 16:38:35.364685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 19 16:38:35.364685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 19 16:38:35.364685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 19 16:38:35.364685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 19 16:38:35.364685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 62ae547b-ada4-4583-9cb2-fc14c5be98c0. Aug 19 16:38:35.364685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:38:35.364685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:38:35.364685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:38:35.364685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:38:35.364685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:38:35.364685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:38:35.364685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:38:35.364685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:38:35.364685 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:38:35.366141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:38:35.366141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 19 16:38:35.366141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 19 16:38:35.366141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4034526-7330-4541-a2cb-d646a572d9d8 is not attached to volume 62ae547b-ada4-4583-9cb2-fc14c5be98c0 Aug 19 16:38:35.366141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:38:35.366141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:38:35.366141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:38:35.366141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:38:35.366141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:38:35.366141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:38:35.366141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:38:35.366141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:38:35.366141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4034526-7330-4541-a2cb-d646a572d9d8 is not attached to volume 62ae547b-ada4-4583-9cb2-fc14c5be98c0 Aug 19 16:38:35.366141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:38:35.366141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d44acaad-c2d6-4837-9186-de82080acaec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Returning 404 to user: Instance d4034526-7330-4541-a2cb-d646a572d9d8 is not attached to volume 62ae547b-ada4-4583-9cb2-fc14c5be98c0 {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:38:35.367070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d44acaad-c2d6-4837-9186-de82080acaec tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/os-volume_attachments/62ae547b-ada4-4583-9cb2-fc14c5be98c0" status: 404 len: 154 microversion: 2.1 time: 0.093438 Aug 19 16:38:35.367070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 502/998] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Aug 19 16:38:35 2022] DELETE /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8/os-volume_attachments/62ae547b-ada4-4583-9cb2-fc14c5be98c0 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:38:35.983253 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-98945a76-3bc7-4a8a-a66f-5a5804f182b7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:35.983870 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-98945a76-3bc7-4a8a-a66f-5a5804f182b7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:35.989820 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-98945a76-3bc7-4a8a-a66f-5a5804f182b7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:35.990297 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-98945a76-3bc7-4a8a-a66f-5a5804f182b7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:35.990740 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-98945a76-3bc7-4a8a-a66f-5a5804f182b7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:35.991425 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-98945a76-3bc7-4a8a-a66f-5a5804f182b7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:35.991881 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-98945a76-3bc7-4a8a-a66f-5a5804f182b7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:35.992315 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-98945a76-3bc7-4a8a-a66f-5a5804f182b7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:36.122488 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-98945a76-3bc7-4a8a-a66f-5a5804f182b7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:36.126120 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=100 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:36.131636 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-98945a76-3bc7-4a8a-a66f-5a5804f182b7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:36.133160 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-98945a76-3bc7-4a8a-a66f-5a5804f182b7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:36.134322 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-98945a76-3bc7-4a8a-a66f-5a5804f182b7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1720 microversion: 2.20 time: 0.155150 Aug 19 16:38:36.134873 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 497/999] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:35 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:37.157869 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-41e0f78c-96eb-4bb0-8c48-4c449ffccea9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:37.158393 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-41e0f78c-96eb-4bb0-8c48-4c449ffccea9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:37.164910 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-41e0f78c-96eb-4bb0-8c48-4c449ffccea9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:37.165385 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-41e0f78c-96eb-4bb0-8c48-4c449ffccea9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:37.165814 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-41e0f78c-96eb-4bb0-8c48-4c449ffccea9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:37.166495 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-41e0f78c-96eb-4bb0-8c48-4c449ffccea9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:37.166944 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-41e0f78c-96eb-4bb0-8c48-4c449ffccea9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:37.167361 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-41e0f78c-96eb-4bb0-8c48-4c449ffccea9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:37.301621 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-41e0f78c-96eb-4bb0-8c48-4c449ffccea9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:37.309916 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-41e0f78c-96eb-4bb0-8c48-4c449ffccea9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:37.311406 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-41e0f78c-96eb-4bb0-8c48-4c449ffccea9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:37.312594 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-41e0f78c-96eb-4bb0-8c48-4c449ffccea9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1720 microversion: 2.20 time: 0.158696 Aug 19 16:38:37.313439 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 503/1000] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:37 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:38.335851 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c8eaccf8-8f1e-451f-9ed7-6874e10c1db4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:38.336515 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c8eaccf8-8f1e-451f-9ed7-6874e10c1db4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:38.343416 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c8eaccf8-8f1e-451f-9ed7-6874e10c1db4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:38.343904 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c8eaccf8-8f1e-451f-9ed7-6874e10c1db4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:38.344357 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c8eaccf8-8f1e-451f-9ed7-6874e10c1db4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:38.345080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c8eaccf8-8f1e-451f-9ed7-6874e10c1db4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:38.345544 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c8eaccf8-8f1e-451f-9ed7-6874e10c1db4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:38.345975 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c8eaccf8-8f1e-451f-9ed7-6874e10c1db4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:38.485268 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c8eaccf8-8f1e-451f-9ed7-6874e10c1db4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:38.493336 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c8eaccf8-8f1e-451f-9ed7-6874e10c1db4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:38.494819 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c8eaccf8-8f1e-451f-9ed7-6874e10c1db4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:38.495962 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c8eaccf8-8f1e-451f-9ed7-6874e10c1db4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1720 microversion: 2.20 time: 0.164139 Aug 19 16:38:38.496507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 498/1001] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:38 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:38.758247 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d5e948c1-97fb-484f-a04a-83c89cc3e7e6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:38.758803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d5e948c1-97fb-484f-a04a-83c89cc3e7e6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:38.766028 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d5e948c1-97fb-484f-a04a-83c89cc3e7e6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:38.766507 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d5e948c1-97fb-484f-a04a-83c89cc3e7e6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:38.766934 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d5e948c1-97fb-484f-a04a-83c89cc3e7e6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:38.767636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d5e948c1-97fb-484f-a04a-83c89cc3e7e6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:38.768078 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d5e948c1-97fb-484f-a04a-83c89cc3e7e6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:38.768492 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d5e948c1-97fb-484f-a04a-83c89cc3e7e6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:38.792873 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d5e948c1-97fb-484f-a04a-83c89cc3e7e6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Going to try to terminate instance {{(pid=127284) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:38:38.866781 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d5e948c1-97fb-484f-a04a-83c89cc3e7e6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 204 len: 0 microversion: 2.1 time: 0.112092 Aug 19 16:38:38.867448 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 504/1002] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:38:38 2022] DELETE /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:38:38.877965 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-263c5ec3-cbd1-4c6d-92ed-bf972140a11e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:38.878606 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-263c5ec3-cbd1-4c6d-92ed-bf972140a11e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:38.885036 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-263c5ec3-cbd1-4c6d-92ed-bf972140a11e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:38.885494 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-263c5ec3-cbd1-4c6d-92ed-bf972140a11e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:38.885925 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-263c5ec3-cbd1-4c6d-92ed-bf972140a11e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:38.886626 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-263c5ec3-cbd1-4c6d-92ed-bf972140a11e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:38.887298 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-263c5ec3-cbd1-4c6d-92ed-bf972140a11e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:38.887841 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-263c5ec3-cbd1-4c6d-92ed-bf972140a11e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:39.018106 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-263c5ec3-cbd1-4c6d-92ed-bf972140a11e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:39.025679 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-263c5ec3-cbd1-4c6d-92ed-bf972140a11e tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1553 microversion: 2.1 time: 0.153950 Aug 19 16:38:39.026237 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 499/1003] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:38 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:39.521503 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-14d06c6a-ebef-4c26-9c6e-006a28dee2f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:39.522804 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-14d06c6a-ebef-4c26-9c6e-006a28dee2f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:39.533147 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-14d06c6a-ebef-4c26-9c6e-006a28dee2f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:39.533763 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-14d06c6a-ebef-4c26-9c6e-006a28dee2f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:39.534324 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-14d06c6a-ebef-4c26-9c6e-006a28dee2f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:39.535034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-14d06c6a-ebef-4c26-9c6e-006a28dee2f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:39.535486 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-14d06c6a-ebef-4c26-9c6e-006a28dee2f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:39.535913 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-14d06c6a-ebef-4c26-9c6e-006a28dee2f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:39.540271 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:39.683859 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-14d06c6a-ebef-4c26-9c6e-006a28dee2f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:39.692669 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-14d06c6a-ebef-4c26-9c6e-006a28dee2f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:39.694457 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-14d06c6a-ebef-4c26-9c6e-006a28dee2f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:39.695605 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-14d06c6a-ebef-4c26-9c6e-006a28dee2f1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1741 microversion: 2.20 time: 0.179504 Aug 19 16:38:39.696158 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 505/1004] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:39 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:40.046924 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-fcdfb624-6570-443b-8405-25a846771645 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:40.047460 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-fcdfb624-6570-443b-8405-25a846771645 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:40.054563 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fcdfb624-6570-443b-8405-25a846771645 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:40.055037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fcdfb624-6570-443b-8405-25a846771645 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:40.055466 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fcdfb624-6570-443b-8405-25a846771645 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:40.056175 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fcdfb624-6570-443b-8405-25a846771645 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:40.056617 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fcdfb624-6570-443b-8405-25a846771645 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:40.057068 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fcdfb624-6570-443b-8405-25a846771645 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:40.185881 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fcdfb624-6570-443b-8405-25a846771645 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:40.194480 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-fcdfb624-6570-443b-8405-25a846771645 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1553 microversion: 2.1 time: 0.151673 Aug 19 16:38:40.195206 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 500/1005] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:40 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:40.722065 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f16bb703-aa30-47b1-ac63-46d1404fde83 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:40.722672 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f16bb703-aa30-47b1-ac63-46d1404fde83 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:40.729306 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f16bb703-aa30-47b1-ac63-46d1404fde83 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:40.729786 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f16bb703-aa30-47b1-ac63-46d1404fde83 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:40.730262 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f16bb703-aa30-47b1-ac63-46d1404fde83 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:40.730976 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f16bb703-aa30-47b1-ac63-46d1404fde83 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:40.731626 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f16bb703-aa30-47b1-ac63-46d1404fde83 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:40.732116 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f16bb703-aa30-47b1-ac63-46d1404fde83 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:40.866704 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f16bb703-aa30-47b1-ac63-46d1404fde83 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:40.875932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f16bb703-aa30-47b1-ac63-46d1404fde83 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:40.877461 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f16bb703-aa30-47b1-ac63-46d1404fde83 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:40.878622 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f16bb703-aa30-47b1-ac63-46d1404fde83 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1741 microversion: 2.20 time: 0.160486 Aug 19 16:38:40.879182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 506/1006] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:40 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:41.215640 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-623d6538-2a24-48d1-afac-208078c156a6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:41.216240 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-623d6538-2a24-48d1-afac-208078c156a6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:41.222590 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-623d6538-2a24-48d1-afac-208078c156a6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:41.223077 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-623d6538-2a24-48d1-afac-208078c156a6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:41.223516 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-623d6538-2a24-48d1-afac-208078c156a6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:41.224213 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-623d6538-2a24-48d1-afac-208078c156a6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:41.224767 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-623d6538-2a24-48d1-afac-208078c156a6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:41.225205 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-623d6538-2a24-48d1-afac-208078c156a6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:41.351272 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-623d6538-2a24-48d1-afac-208078c156a6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:41.359547 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-623d6538-2a24-48d1-afac-208078c156a6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1553 microversion: 2.1 time: 0.147940 Aug 19 16:38:41.360121 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 501/1007] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:41 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:41.809709 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-3f835d63-c271-4274-a1bc-0e14dae93de3 req-423ebdf2-5dbc-4cea-9f3a-7e26a48973ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4034526-7330-4541-a2cb-d646a572d9d8", "name": "network-vif-deleted", "tag": "498a3f32-b577-44b6-8701-625d4a4962ec"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:38:41.822706 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-3f835d63-c271-4274-a1bc-0e14dae93de3 req-423ebdf2-5dbc-4cea-9f3a-7e26a48973ab service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:41.823495 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-3f835d63-c271-4274-a1bc-0e14dae93de3 req-423ebdf2-5dbc-4cea-9f3a-7e26a48973ab service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:41.824288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-3f835d63-c271-4274-a1bc-0e14dae93de3 req-423ebdf2-5dbc-4cea-9f3a-7e26a48973ab service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:41.836425 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-3f835d63-c271-4274-a1bc-0e14dae93de3 req-423ebdf2-5dbc-4cea-9f3a-7e26a48973ab service nova] Creating event network-vif-deleted:498a3f32-b577-44b6-8701-625d4a4962ec for instance d4034526-7330-4541-a2cb-d646a572d9d8 on hv-cinder-83124 Aug 19 16:38:41.841997 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-3f835d63-c271-4274-a1bc-0e14dae93de3 req-423ebdf2-5dbc-4cea-9f3a-7e26a48973ab service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036185 Aug 19 16:38:41.842519 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 507/1008] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:38:41.901743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-7d549132-8204-4e31-a4e0-39f8e63837e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:41.902345 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-7d549132-8204-4e31-a4e0-39f8e63837e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:41.908891 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7d549132-8204-4e31-a4e0-39f8e63837e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:41.909369 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7d549132-8204-4e31-a4e0-39f8e63837e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:41.909799 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7d549132-8204-4e31-a4e0-39f8e63837e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:41.910477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7d549132-8204-4e31-a4e0-39f8e63837e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:41.910931 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7d549132-8204-4e31-a4e0-39f8e63837e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:41.911349 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7d549132-8204-4e31-a4e0-39f8e63837e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:42.038314 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7d549132-8204-4e31-a4e0-39f8e63837e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:42.046412 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7d549132-8204-4e31-a4e0-39f8e63837e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:42.047893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7d549132-8204-4e31-a4e0-39f8e63837e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:42.049053 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-7d549132-8204-4e31-a4e0-39f8e63837e9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1741 microversion: 2.20 time: 0.151174 Aug 19 16:38:42.049597 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 502/1009] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:41 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1741 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:42.382209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7b6101b4-2005-4938-a539-0a1b296b0b20 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:42.382805 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7b6101b4-2005-4938-a539-0a1b296b0b20 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:42.389514 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7b6101b4-2005-4938-a539-0a1b296b0b20 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:42.389985 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7b6101b4-2005-4938-a539-0a1b296b0b20 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:42.390413 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7b6101b4-2005-4938-a539-0a1b296b0b20 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:42.391087 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7b6101b4-2005-4938-a539-0a1b296b0b20 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:42.391531 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7b6101b4-2005-4938-a539-0a1b296b0b20 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:42.391947 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7b6101b4-2005-4938-a539-0a1b296b0b20 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:42.454050 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7b6101b4-2005-4938-a539-0a1b296b0b20 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:42.461638 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7b6101b4-2005-4938-a539-0a1b296b0b20 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1511 microversion: 2.1 time: 0.083725 Aug 19 16:38:42.462195 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 508/1010] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:42 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1511 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:43.072089 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b26f43c3-e8b8-4fbc-b384-e896000732a6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:43.072698 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b26f43c3-e8b8-4fbc-b384-e896000732a6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:43.079275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b26f43c3-e8b8-4fbc-b384-e896000732a6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:43.079757 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b26f43c3-e8b8-4fbc-b384-e896000732a6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:43.080190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b26f43c3-e8b8-4fbc-b384-e896000732a6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:43.080911 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b26f43c3-e8b8-4fbc-b384-e896000732a6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:43.081367 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b26f43c3-e8b8-4fbc-b384-e896000732a6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:43.081790 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b26f43c3-e8b8-4fbc-b384-e896000732a6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:43.213207 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b26f43c3-e8b8-4fbc-b384-e896000732a6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:43.221807 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b26f43c3-e8b8-4fbc-b384-e896000732a6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:43.223325 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b26f43c3-e8b8-4fbc-b384-e896000732a6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:43.224508 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b26f43c3-e8b8-4fbc-b384-e896000732a6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1741 microversion: 2.20 time: 0.156852 Aug 19 16:38:43.225089 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 503/1011] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:43 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:43.482578 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-49a820ea-99f1-4046-b605-2046cbe5a22b tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:43.483185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-49a820ea-99f1-4046-b605-2046cbe5a22b tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:43.489608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-49a820ea-99f1-4046-b605-2046cbe5a22b tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:43.490080 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-49a820ea-99f1-4046-b605-2046cbe5a22b tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:43.490509 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-49a820ea-99f1-4046-b605-2046cbe5a22b tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:43.491191 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-49a820ea-99f1-4046-b605-2046cbe5a22b tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:43.491634 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-49a820ea-99f1-4046-b605-2046cbe5a22b tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:43.492051 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-49a820ea-99f1-4046-b605-2046cbe5a22b tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:43.557229 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-49a820ea-99f1-4046-b605-2046cbe5a22b tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:43.565298 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-49a820ea-99f1-4046-b605-2046cbe5a22b tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1511 microversion: 2.1 time: 0.086708 Aug 19 16:38:43.565866 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 509/1012] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:43 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1511 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:44.248333 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-21f9e2f5-72fc-4685-8a27-89fc64a33eb2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:44.248990 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-21f9e2f5-72fc-4685-8a27-89fc64a33eb2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:44.255364 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-21f9e2f5-72fc-4685-8a27-89fc64a33eb2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:44.255851 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-21f9e2f5-72fc-4685-8a27-89fc64a33eb2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:44.256292 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-21f9e2f5-72fc-4685-8a27-89fc64a33eb2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:44.257017 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-21f9e2f5-72fc-4685-8a27-89fc64a33eb2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:44.257476 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-21f9e2f5-72fc-4685-8a27-89fc64a33eb2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:44.257906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-21f9e2f5-72fc-4685-8a27-89fc64a33eb2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:44.382899 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-21f9e2f5-72fc-4685-8a27-89fc64a33eb2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:44.390924 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-21f9e2f5-72fc-4685-8a27-89fc64a33eb2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:44.392422 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-21f9e2f5-72fc-4685-8a27-89fc64a33eb2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:44.393602 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-21f9e2f5-72fc-4685-8a27-89fc64a33eb2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1741 microversion: 2.20 time: 0.150197 Aug 19 16:38:44.394159 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 504/1013] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:44 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1741 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:44.590991 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-83ef88ce-18cb-4d86-82a5-3eaa71a01fd6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:44.592677 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-83ef88ce-18cb-4d86-82a5-3eaa71a01fd6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:44.599812 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-83ef88ce-18cb-4d86-82a5-3eaa71a01fd6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:44.600318 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-83ef88ce-18cb-4d86-82a5-3eaa71a01fd6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:44.600796 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-83ef88ce-18cb-4d86-82a5-3eaa71a01fd6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:44.601491 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-83ef88ce-18cb-4d86-82a5-3eaa71a01fd6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:44.601938 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-83ef88ce-18cb-4d86-82a5-3eaa71a01fd6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:44.602352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-83ef88ce-18cb-4d86-82a5-3eaa71a01fd6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:44.635841 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-83ef88ce-18cb-4d86-82a5-3eaa71a01fd6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:44.636319 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-83ef88ce-18cb-4d86-82a5-3eaa71a01fd6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:44.636764 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-83ef88ce-18cb-4d86-82a5-3eaa71a01fd6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:44.637250 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.objects.instance [None req-83ef88ce-18cb-4d86-82a5-3eaa71a01fd6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lazy-loading 'fault' on Instance uuid d4034526-7330-4541-a2cb-d646a572d9d8 {{(pid=127284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:38:44.686782 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-83ef88ce-18cb-4d86-82a5-3eaa71a01fd6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1371337c03435faa5f1db60168cfbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41afd08d1324396940e3acaf49a34b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:44.694691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-83ef88ce-18cb-4d86-82a5-3eaa71a01fd6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 200 len: 1348 microversion: 2.1 time: 0.110571 Aug 19 16:38:44.695262 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 510/1014] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:44 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 1348 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:38:44.703736 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-b856c59f-f391-40b4-b0d2-d4534dc094d8 req-88735095-02b7-46f2-80be-37235a328b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf04a2f-684c-4e14-8def-16324168613c", "name": "network-vif-plugged", "status": "completed", "tag": "6f7012e8-b52a-4e31-8e3e-9304cba097fe"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:38:44.711519 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-b856c59f-f391-40b4-b0d2-d4534dc094d8 req-88735095-02b7-46f2-80be-37235a328b30 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:44.711994 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-b856c59f-f391-40b4-b0d2-d4534dc094d8 req-88735095-02b7-46f2-80be-37235a328b30 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:44.712437 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-b856c59f-f391-40b4-b0d2-d4534dc094d8 req-88735095-02b7-46f2-80be-37235a328b30 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:44.717731 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 16:38:44.717910 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Fri Aug 19 16:38:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 16:38:44.727547 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-b856c59f-f391-40b4-b0d2-d4534dc094d8 req-88735095-02b7-46f2-80be-37235a328b30 service nova] Creating event network-vif-plugged:6f7012e8-b52a-4e31-8e3e-9304cba097fe for instance 5cf04a2f-684c-4e14-8def-16324168613c on hv-cinder-83124 Aug 19 16:38:44.733083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-b856c59f-f391-40b4-b0d2-d4534dc094d8 req-88735095-02b7-46f2-80be-37235a328b30 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035280 Aug 19 16:38:44.733783 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 505/1015] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:38:45.417572 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d7bbb60a-3781-4022-a787-73e53e8bb026 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:45.418320 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d7bbb60a-3781-4022-a787-73e53e8bb026 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:45.424450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d7bbb60a-3781-4022-a787-73e53e8bb026 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:45.425050 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d7bbb60a-3781-4022-a787-73e53e8bb026 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:45.425515 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d7bbb60a-3781-4022-a787-73e53e8bb026 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:45.426279 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d7bbb60a-3781-4022-a787-73e53e8bb026 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:45.426777 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d7bbb60a-3781-4022-a787-73e53e8bb026 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:45.427461 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d7bbb60a-3781-4022-a787-73e53e8bb026 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:45.576405 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d7bbb60a-3781-4022-a787-73e53e8bb026 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:45.588138 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d7bbb60a-3781-4022-a787-73e53e8bb026 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:45.589795 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d7bbb60a-3781-4022-a787-73e53e8bb026 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:45.591264 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d7bbb60a-3781-4022-a787-73e53e8bb026 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1741 microversion: 2.20 time: 0.177621 Aug 19 16:38:45.591845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 511/1016] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:45 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:45.718399 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-471dab95-f166-4e63-9f4d-72309452387f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:45.719111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-471dab95-f166-4e63-9f4d-72309452387f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] [instance: d4034526-7330-4541-a2cb-d646a572d9d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:45.730170 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-471dab95-f166-4e63-9f4d-72309452387f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:45.731276 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-471dab95-f166-4e63-9f4d-72309452387f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:45.732364 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-471dab95-f166-4e63-9f4d-72309452387f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:45.733318 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-471dab95-f166-4e63-9f4d-72309452387f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:45.734087 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-471dab95-f166-4e63-9f4d-72309452387f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:45.734972 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-471dab95-f166-4e63-9f4d-72309452387f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:45.751977 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-471dab95-f166-4e63-9f4d-72309452387f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] HTTP exception thrown: Instance d4034526-7330-4541-a2cb-d646a572d9d8 could not be found. Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-471dab95-f166-4e63-9f4d-72309452387f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Request method failure captured: Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 HTTP/1.1 Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7u3WbDmOd3hx3peZN23J3WZyUNYhpRBqvgmxiUp1R-GqwU0cHkjMHoNpSOowelgmdiGl5BVZcPCjfUUu1FDVQt2kjwYzuycDRQykRgl4XV7ju7Zo-Jy_cV9Y7YkIwLaELTZFe8vH4h2hNRK6yr7Frar7LdtpxmZGRLtQnrX49liK9Q Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: a41afd08d1324396940e3acaf49a34b3 Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-TestMinimumBasicScenario-2010189058 Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:38:45.753917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:38:45.755268 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a41afd08d1324396940e3acaf49a34b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a41afd08d1324396940e3acaf49a34b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a41afd08d1324396940e3acaf49a34b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a41afd08d1324396940e3acaf49a34b3"}]}] Aug 19 16:38:45.755268 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-TestMinimumBasicScenario-2010189058 Aug 19 16:38:45.755268 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: a41afd08d1324396940e3acaf49a34b3 Aug 19 16:38:45.755268 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2010189058 Aug 19 16:38:45.755268 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-TestMinimumBasicScenario-2010189058-project Aug 19 16:38:45.755268 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:38:45.755268 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:38:45.755268 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: cf1371337c03435faa5f1db60168cfbe Aug 19 16:38:45.755268 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-TestMinimumBasicScenario-2010189058-project Aug 19 16:38:45.755268 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:38:45.755268 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance d4034526-7330-4541-a2cb-d646a572d9d8 could not be found. Aug 19 16:38:45.755268 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': 'd4034526-7330-4541-a2cb-d646a572d9d8'} Aug 19 16:38:45.756008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:38:45.756008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:38:45.756008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:38:45.756008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:38:45.756008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:38:45.756008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:38:45.756008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:38:45.756008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:38:45.756008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:38:45.756008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:38:45.756008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4034526-7330-4541-a2cb-d646a572d9d8 could not be found. Aug 19 16:38:45.756008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:38:45.756008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:38:45.756008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:38:45.756008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:38:45.756008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:38:45.756008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:38:45.756008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:38:45.756008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:38:45.756008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:38:45.757227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:38:45.757227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:38:45.757227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:38:45.757227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:38:45.757227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:38:45.757227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:38:45.757227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:38:45.757227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4034526-7330-4541-a2cb-d646a572d9d8 could not be found. Aug 19 16:38:45.757227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:38:45.757227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:38:45.757227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:38:45.757227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:38:45.757227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:38:45.757227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:38:45.757227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:38:45.757227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:38:45.757227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4034526-7330-4541-a2cb-d646a572d9d8 could not be found. Aug 19 16:38:45.757227 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:38:45.759652 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-471dab95-f166-4e63-9f4d-72309452387f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Returning 404 to user: Instance d4034526-7330-4541-a2cb-d646a572d9d8 could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:38:45.760687 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-471dab95-f166-4e63-9f4d-72309452387f tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8" status: 404 len: 111 microversion: 2.1 time: 0.048715 Aug 19 16:38:45.761812 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 506/1017] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:38:45 2022] GET /compute/v2.1/servers/d4034526-7330-4541-a2cb-d646a572d9d8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:38:45.771609 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e28c9062-618c-4525-b377-92ca8c636ec6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] Calling method '.version_select at 0x7fb01e0384c0>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:45.792033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e28c9062-618c-4525-b377-92ca8c636ec6 tempest-TestMinimumBasicScenario-2010189058 tempest-TestMinimumBasicScenario-2010189058-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-653141891" status: 202 len: 0 microversion: 2.1 time: 0.024526 Aug 19 16:38:45.792696 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 512/1018] 10.222.0.55 () {58 vars in 1269 bytes} [Fri Aug 19 16:38:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-653141891 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:38:46.616539 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d3c8e30e-3dca-4681-8356-f40814249b15 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:46.617173 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d3c8e30e-3dca-4681-8356-f40814249b15 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:46.626952 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d3c8e30e-3dca-4681-8356-f40814249b15 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:46.627450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d3c8e30e-3dca-4681-8356-f40814249b15 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:46.627890 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d3c8e30e-3dca-4681-8356-f40814249b15 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:46.628628 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d3c8e30e-3dca-4681-8356-f40814249b15 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:46.629277 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d3c8e30e-3dca-4681-8356-f40814249b15 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:46.629713 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d3c8e30e-3dca-4681-8356-f40814249b15 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:46.797039 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d3c8e30e-3dca-4681-8356-f40814249b15 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:46.807811 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d3c8e30e-3dca-4681-8356-f40814249b15 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:46.809665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d3c8e30e-3dca-4681-8356-f40814249b15 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:46.811113 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d3c8e30e-3dca-4681-8356-f40814249b15 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1736 microversion: 2.20 time: 0.199994 Aug 19 16:38:46.812142 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 507/1019] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:46 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:47.840693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-aeb7723a-7162-4ef7-80d9-7ac51a0be49a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:47.841976 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-aeb7723a-7162-4ef7-80d9-7ac51a0be49a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:47.852850 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-aeb7723a-7162-4ef7-80d9-7ac51a0be49a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:47.853768 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-aeb7723a-7162-4ef7-80d9-7ac51a0be49a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:47.855806 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-aeb7723a-7162-4ef7-80d9-7ac51a0be49a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:47.857143 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-aeb7723a-7162-4ef7-80d9-7ac51a0be49a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:47.857622 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-aeb7723a-7162-4ef7-80d9-7ac51a0be49a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:47.858045 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-aeb7723a-7162-4ef7-80d9-7ac51a0be49a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:48.362584 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-aeb7723a-7162-4ef7-80d9-7ac51a0be49a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:48.376508 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-aeb7723a-7162-4ef7-80d9-7ac51a0be49a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:48.378471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-aeb7723a-7162-4ef7-80d9-7ac51a0be49a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:48.380046 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-aeb7723a-7162-4ef7-80d9-7ac51a0be49a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1736 microversion: 2.20 time: 0.544919 Aug 19 16:38:48.398360 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 513/1020] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:47 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1736 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:49.403427 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-36bc8117-95be-4ce8-bfb7-c3309a024857 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:49.404649 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-36bc8117-95be-4ce8-bfb7-c3309a024857 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:49.414327 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-36bc8117-95be-4ce8-bfb7-c3309a024857 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:49.414998 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-36bc8117-95be-4ce8-bfb7-c3309a024857 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:49.426751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-36bc8117-95be-4ce8-bfb7-c3309a024857 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:49.427775 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-36bc8117-95be-4ce8-bfb7-c3309a024857 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:49.428470 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-36bc8117-95be-4ce8-bfb7-c3309a024857 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:49.429487 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-36bc8117-95be-4ce8-bfb7-c3309a024857 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:49.681141 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-36bc8117-95be-4ce8-bfb7-c3309a024857 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:49.693994 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-36bc8117-95be-4ce8-bfb7-c3309a024857 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:49.695637 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-36bc8117-95be-4ce8-bfb7-c3309a024857 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:49.697029 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-36bc8117-95be-4ce8-bfb7-c3309a024857 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1736 microversion: 2.20 time: 0.297494 Aug 19 16:38:49.697841 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 508/1021] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:49 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1736 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:50.720478 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f8b366d8-dc2a-4363-9749-65a0ad05e237 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:50.721295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f8b366d8-dc2a-4363-9749-65a0ad05e237 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:50.733864 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f8b366d8-dc2a-4363-9749-65a0ad05e237 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:50.735299 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f8b366d8-dc2a-4363-9749-65a0ad05e237 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:50.737789 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f8b366d8-dc2a-4363-9749-65a0ad05e237 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:50.739182 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f8b366d8-dc2a-4363-9749-65a0ad05e237 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:50.739867 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f8b366d8-dc2a-4363-9749-65a0ad05e237 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:50.740448 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f8b366d8-dc2a-4363-9749-65a0ad05e237 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:50.933193 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f8b366d8-dc2a-4363-9749-65a0ad05e237 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:50.955009 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f8b366d8-dc2a-4363-9749-65a0ad05e237 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:50.957010 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f8b366d8-dc2a-4363-9749-65a0ad05e237 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:50.962162 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f8b366d8-dc2a-4363-9749-65a0ad05e237 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1736 microversion: 2.20 time: 0.245216 Aug 19 16:38:50.963351 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 514/1022] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:50 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1736 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:38:52.001226 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-5779cbf4-0ee1-4681-801c-a328609aaabc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:52.002789 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-5779cbf4-0ee1-4681-801c-a328609aaabc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:52.010010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5779cbf4-0ee1-4681-801c-a328609aaabc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:52.010827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5779cbf4-0ee1-4681-801c-a328609aaabc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:52.011431 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5779cbf4-0ee1-4681-801c-a328609aaabc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:52.012389 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5779cbf4-0ee1-4681-801c-a328609aaabc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:52.013168 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5779cbf4-0ee1-4681-801c-a328609aaabc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:52.013774 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5779cbf4-0ee1-4681-801c-a328609aaabc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:52.202674 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5779cbf4-0ee1-4681-801c-a328609aaabc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:52.216299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5779cbf4-0ee1-4681-801c-a328609aaabc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:52.218208 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5779cbf4-0ee1-4681-801c-a328609aaabc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:52.219651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-5779cbf4-0ee1-4681-801c-a328609aaabc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1736 microversion: 2.20 time: 0.223607 Aug 19 16:38:52.222061 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 509/1023] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:51 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:53.244148 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-44a8bfc6-f3ae-4abd-924d-f76373f7e3b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:53.244864 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-44a8bfc6-f3ae-4abd-924d-f76373f7e3b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:53.251873 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-44a8bfc6-f3ae-4abd-924d-f76373f7e3b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:53.252352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-44a8bfc6-f3ae-4abd-924d-f76373f7e3b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:53.252809 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-44a8bfc6-f3ae-4abd-924d-f76373f7e3b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:53.253775 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-44a8bfc6-f3ae-4abd-924d-f76373f7e3b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:53.254533 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-44a8bfc6-f3ae-4abd-924d-f76373f7e3b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:53.255166 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-44a8bfc6-f3ae-4abd-924d-f76373f7e3b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:53.441103 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-44a8bfc6-f3ae-4abd-924d-f76373f7e3b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:53.456300 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-44a8bfc6-f3ae-4abd-924d-f76373f7e3b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:53.458578 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-44a8bfc6-f3ae-4abd-924d-f76373f7e3b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:53.460721 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-44a8bfc6-f3ae-4abd-924d-f76373f7e3b1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1736 microversion: 2.20 time: 0.220889 Aug 19 16:38:53.461788 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 515/1024] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:53 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:54.484287 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4763c947-5355-41a1-9731-c74176e3c4b2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:54.484999 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-4763c947-5355-41a1-9731-c74176e3c4b2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:54.491343 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4763c947-5355-41a1-9731-c74176e3c4b2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:54.491837 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4763c947-5355-41a1-9731-c74176e3c4b2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:54.492273 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4763c947-5355-41a1-9731-c74176e3c4b2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:54.493032 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4763c947-5355-41a1-9731-c74176e3c4b2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:54.493488 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4763c947-5355-41a1-9731-c74176e3c4b2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:54.493915 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4763c947-5355-41a1-9731-c74176e3c4b2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:54.747708 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-4763c947-5355-41a1-9731-c74176e3c4b2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:54.766404 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-4763c947-5355-41a1-9731-c74176e3c4b2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:54.769781 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-4763c947-5355-41a1-9731-c74176e3c4b2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:54.774199 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4763c947-5355-41a1-9731-c74176e3c4b2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1736 microversion: 2.20 time: 0.294675 Aug 19 16:38:54.775013 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 510/1025] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:54 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1736 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:55.800576 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-4bf3ff57-dae5-4bfb-80d1-336e31cd95b5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:55.802080 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-4bf3ff57-dae5-4bfb-80d1-336e31cd95b5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:55.810529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4bf3ff57-dae5-4bfb-80d1-336e31cd95b5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:55.811861 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4bf3ff57-dae5-4bfb-80d1-336e31cd95b5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:55.812499 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4bf3ff57-dae5-4bfb-80d1-336e31cd95b5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:55.813912 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4bf3ff57-dae5-4bfb-80d1-336e31cd95b5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:55.814556 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4bf3ff57-dae5-4bfb-80d1-336e31cd95b5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:55.815253 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4bf3ff57-dae5-4bfb-80d1-336e31cd95b5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:56.283527 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-4bf3ff57-dae5-4bfb-80d1-336e31cd95b5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:56.298245 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-4bf3ff57-dae5-4bfb-80d1-336e31cd95b5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:56.299992 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-4bf3ff57-dae5-4bfb-80d1-336e31cd95b5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:56.305777 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-4bf3ff57-dae5-4bfb-80d1-336e31cd95b5 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1736 microversion: 2.20 time: 0.509705 Aug 19 16:38:56.306773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 516/1026] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:55 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1736 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:57.331223 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-865698f2-4ff0-456f-b85f-cd9947953fdc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:57.331837 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-865698f2-4ff0-456f-b85f-cd9947953fdc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:57.338390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-865698f2-4ff0-456f-b85f-cd9947953fdc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:57.338872 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-865698f2-4ff0-456f-b85f-cd9947953fdc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:57.339308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-865698f2-4ff0-456f-b85f-cd9947953fdc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:57.339995 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-865698f2-4ff0-456f-b85f-cd9947953fdc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:57.340447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-865698f2-4ff0-456f-b85f-cd9947953fdc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:57.340903 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-865698f2-4ff0-456f-b85f-cd9947953fdc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:57.469821 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-865698f2-4ff0-456f-b85f-cd9947953fdc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:57.478061 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-865698f2-4ff0-456f-b85f-cd9947953fdc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:57.479572 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-865698f2-4ff0-456f-b85f-cd9947953fdc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:57.480955 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-865698f2-4ff0-456f-b85f-cd9947953fdc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1718 microversion: 2.20 time: 0.153416 Aug 19 16:38:57.481511 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 511/1027] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:57 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:38:58.503998 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-48be94d0-09cc-4e2f-a768-001893162270 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:58.504611 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-48be94d0-09cc-4e2f-a768-001893162270 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:58.511102 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-48be94d0-09cc-4e2f-a768-001893162270 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:58.511577 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-48be94d0-09cc-4e2f-a768-001893162270 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:58.512609 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-48be94d0-09cc-4e2f-a768-001893162270 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:58.513321 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-48be94d0-09cc-4e2f-a768-001893162270 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:58.513768 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-48be94d0-09cc-4e2f-a768-001893162270 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:58.514187 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-48be94d0-09cc-4e2f-a768-001893162270 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:58.641596 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-48be94d0-09cc-4e2f-a768-001893162270 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:58.649999 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-48be94d0-09cc-4e2f-a768-001893162270 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:58.651537 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-48be94d0-09cc-4e2f-a768-001893162270 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:58.653520 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-48be94d0-09cc-4e2f-a768-001893162270 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1718 microversion: 2.20 time: 0.153137 Aug 19 16:38:58.654214 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 517/1028] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:58 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:38:59.676992 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-5aad9f27-2002-4014-9ca3-32d3b4f720f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:38:59.677605 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-5aad9f27-2002-4014-9ca3-32d3b4f720f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:38:59.680075 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=52 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:38:59.686217 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5aad9f27-2002-4014-9ca3-32d3b4f720f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:59.686695 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5aad9f27-2002-4014-9ca3-32d3b4f720f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:59.687123 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5aad9f27-2002-4014-9ca3-32d3b4f720f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:59.687871 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5aad9f27-2002-4014-9ca3-32d3b4f720f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:38:59.688317 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5aad9f27-2002-4014-9ca3-32d3b4f720f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:38:59.688736 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-5aad9f27-2002-4014-9ca3-32d3b4f720f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:38:59.822313 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5aad9f27-2002-4014-9ca3-32d3b4f720f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:59.830787 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5aad9f27-2002-4014-9ca3-32d3b4f720f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:59.832263 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-5aad9f27-2002-4014-9ca3-32d3b4f720f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:38:59.833451 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-5aad9f27-2002-4014-9ca3-32d3b4f720f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1718 microversion: 2.20 time: 0.160452 Aug 19 16:38:59.833993 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 512/1029] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:38:59 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1718 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:39:00.672312 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-340aa6d0-2712-4599-a0fc-c45cffdfb1f0 req-c258d163-94b0-4513-872d-f010268d9872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf04a2f-684c-4e14-8def-16324168613c", "name": "network-vif-unplugged", "status": "completed", "tag": "6f7012e8-b52a-4e31-8e3e-9304cba097fe"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:39:00.683972 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-340aa6d0-2712-4599-a0fc-c45cffdfb1f0 req-c258d163-94b0-4513-872d-f010268d9872 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:00.684450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-340aa6d0-2712-4599-a0fc-c45cffdfb1f0 req-c258d163-94b0-4513-872d-f010268d9872 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:00.685151 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-340aa6d0-2712-4599-a0fc-c45cffdfb1f0 req-c258d163-94b0-4513-872d-f010268d9872 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:00.696893 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.compute.server_external_events [req-340aa6d0-2712-4599-a0fc-c45cffdfb1f0 req-c258d163-94b0-4513-872d-f010268d9872 service nova] Unable to find a host for instance 5cf04a2f-684c-4e14-8def-16324168613c. Dropping event network-vif-unplugged {{(pid=127284) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 19 16:39:00.697754 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-340aa6d0-2712-4599-a0fc-c45cffdfb1f0 req-c258d163-94b0-4513-872d-f010268d9872 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029468 Aug 19 16:39:00.698476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 518/1030] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 19 16:39:00.856262 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c82b90e6-6770-4196-8c55-fa68997f7ffc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:00.856834 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c82b90e6-6770-4196-8c55-fa68997f7ffc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:00.863245 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c82b90e6-6770-4196-8c55-fa68997f7ffc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:00.863733 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c82b90e6-6770-4196-8c55-fa68997f7ffc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:00.864171 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c82b90e6-6770-4196-8c55-fa68997f7ffc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:00.864959 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c82b90e6-6770-4196-8c55-fa68997f7ffc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:00.865420 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c82b90e6-6770-4196-8c55-fa68997f7ffc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:00.865847 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c82b90e6-6770-4196-8c55-fa68997f7ffc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:00.997376 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c82b90e6-6770-4196-8c55-fa68997f7ffc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:01.005382 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c82b90e6-6770-4196-8c55-fa68997f7ffc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:01.006875 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c82b90e6-6770-4196-8c55-fa68997f7ffc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:01.008018 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c82b90e6-6770-4196-8c55-fa68997f7ffc tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1661 microversion: 2.20 time: 0.156018 Aug 19 16:39:01.008603 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 513/1031] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:00 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1661 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:39:01.030452 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7dc6933b-d292-4f25-9ef0-422270bd45e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0000da0-2c15-4f9a-bd0b-3860cefad981"}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:39:01.032796 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7dc6933b-d292-4f25-9ef0-422270bd45e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:01.038683 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7dc6933b-d292-4f25-9ef0-422270bd45e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:01.039173 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7dc6933b-d292-4f25-9ef0-422270bd45e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:01.039614 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7dc6933b-d292-4f25-9ef0-422270bd45e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:01.040305 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7dc6933b-d292-4f25-9ef0-422270bd45e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:01.040779 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7dc6933b-d292-4f25-9ef0-422270bd45e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:01.041209 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-7dc6933b-d292-4f25-9ef0-422270bd45e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:01.318222 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7dc6933b-d292-4f25-9ef0-422270bd45e6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "POST /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.291709 Aug 19 16:39:01.318830 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 519/1032] 10.222.0.55 () {62 vars in 1364 bytes} [Fri Aug 19 16:39:01 2022] POST /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c/os-volume_attachments => generated 188 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 16:39:01.440740 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-038a1e83-baa1-476d-82eb-d9dff841cec7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:01.441276 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-038a1e83-baa1-476d-82eb-d9dff841cec7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:01.447393 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-038a1e83-baa1-476d-82eb-d9dff841cec7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:01.447883 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-038a1e83-baa1-476d-82eb-d9dff841cec7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:01.448319 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-038a1e83-baa1-476d-82eb-d9dff841cec7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:01.449585 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-038a1e83-baa1-476d-82eb-d9dff841cec7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:01.450132 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-038a1e83-baa1-476d-82eb-d9dff841cec7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:01.450560 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-038a1e83-baa1-476d-82eb-d9dff841cec7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:01.544535 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:01.687328 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-038a1e83-baa1-476d-82eb-d9dff841cec7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c/os-volume_attachments/f0000da0-2c15-4f9a-bd0b-3860cefad981" status: 202 len: 0 microversion: 2.20 time: 0.250336 Aug 19 16:39:01.687922 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 514/1033] 10.222.0.55 () {60 vars in 1457 bytes} [Fri Aug 19 16:39:01 2022] DELETE /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c/os-volume_attachments/f0000da0-2c15-4f9a-bd0b-3860cefad981 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:39:01.751977 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-9ffd2652-238a-410a-b3f3-80acd51fc9ce tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:39:01.752571 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-9ffd2652-238a-410a-b3f3-80acd51fc9ce tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:01.759758 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9ffd2652-238a-410a-b3f3-80acd51fc9ce tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:01.760237 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9ffd2652-238a-410a-b3f3-80acd51fc9ce tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:01.760678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9ffd2652-238a-410a-b3f3-80acd51fc9ce tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:01.761394 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9ffd2652-238a-410a-b3f3-80acd51fc9ce tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:01.762469 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9ffd2652-238a-410a-b3f3-80acd51fc9ce tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:01.762997 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9ffd2652-238a-410a-b3f3-80acd51fc9ce tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:01.791509 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-9ffd2652-238a-410a-b3f3-80acd51fc9ce tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127284) unshelve /opt/stack/nova/nova/compute/api.py:4584}} Aug 19 16:39:01.827131 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:01.863801 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-9ffd2652-238a-410a-b3f3-80acd51fc9ce tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "POST /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c/action" status: 202 len: 0 microversion: 2.20 time: 0.115131 Aug 19 16:39:01.863801 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 520/1034] 10.222.0.55 () {62 vars in 1319 bytes} [Fri Aug 19 16:39:01 2022] POST /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 19 16:39:01.873415 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e25718b0-e403-48b2-9123-ec8f600d0a89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:01.875638 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e25718b0-e403-48b2-9123-ec8f600d0a89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:01.883904 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e25718b0-e403-48b2-9123-ec8f600d0a89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:01.884455 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e25718b0-e403-48b2-9123-ec8f600d0a89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:01.884954 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e25718b0-e403-48b2-9123-ec8f600d0a89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:01.885928 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e25718b0-e403-48b2-9123-ec8f600d0a89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:01.886388 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e25718b0-e403-48b2-9123-ec8f600d0a89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:01.887495 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e25718b0-e403-48b2-9123-ec8f600d0a89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:02.054470 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e25718b0-e403-48b2-9123-ec8f600d0a89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:02.063471 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e25718b0-e403-48b2-9123-ec8f600d0a89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:02.065012 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e25718b0-e403-48b2-9123-ec8f600d0a89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:02.066173 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e25718b0-e403-48b2-9123-ec8f600d0a89 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1669 microversion: 2.20 time: 0.197778 Aug 19 16:39:02.066724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 515/1035] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:01 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1669 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:39:03.090295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-0f056a56-54b4-4c24-8701-b69478005bf7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:03.090999 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-0f056a56-54b4-4c24-8701-b69478005bf7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:03.092943 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:03.098213 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0f056a56-54b4-4c24-8701-b69478005bf7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:03.098779 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0f056a56-54b4-4c24-8701-b69478005bf7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:03.099139 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0f056a56-54b4-4c24-8701-b69478005bf7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:03.099876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0f056a56-54b4-4c24-8701-b69478005bf7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:03.100331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0f056a56-54b4-4c24-8701-b69478005bf7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:03.100782 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0f056a56-54b4-4c24-8701-b69478005bf7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:03.234379 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-0f056a56-54b4-4c24-8701-b69478005bf7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:03.243224 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-0f056a56-54b4-4c24-8701-b69478005bf7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:03.244794 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-0f056a56-54b4-4c24-8701-b69478005bf7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:03.246628 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-0f056a56-54b4-4c24-8701-b69478005bf7 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1727 microversion: 2.20 time: 0.160969 Aug 19 16:39:03.247197 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 521/1036] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:03 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:39:04.273462 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6efadc13-d378-4f39-9808-13f48c66075a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:04.274109 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6efadc13-d378-4f39-9808-13f48c66075a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:04.280679 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6efadc13-d378-4f39-9808-13f48c66075a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:04.281304 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6efadc13-d378-4f39-9808-13f48c66075a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:04.281844 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6efadc13-d378-4f39-9808-13f48c66075a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:04.282793 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6efadc13-d378-4f39-9808-13f48c66075a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:04.283254 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6efadc13-d378-4f39-9808-13f48c66075a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:04.283691 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6efadc13-d378-4f39-9808-13f48c66075a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:04.440493 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6efadc13-d378-4f39-9808-13f48c66075a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:04.450207 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6efadc13-d378-4f39-9808-13f48c66075a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:04.451886 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6efadc13-d378-4f39-9808-13f48c66075a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:04.453107 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6efadc13-d378-4f39-9808-13f48c66075a tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1727 microversion: 2.20 time: 0.186032 Aug 19 16:39:04.464045 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 516/1037] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:04 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1727 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:39:05.478802 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c078400a-c073-423b-b3d3-ded43513d460 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:05.479557 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-c078400a-c073-423b-b3d3-ded43513d460 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:05.488422 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c078400a-c073-423b-b3d3-ded43513d460 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:05.488967 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c078400a-c073-423b-b3d3-ded43513d460 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:05.489579 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c078400a-c073-423b-b3d3-ded43513d460 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:05.490543 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c078400a-c073-423b-b3d3-ded43513d460 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:05.491278 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c078400a-c073-423b-b3d3-ded43513d460 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:05.491763 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c078400a-c073-423b-b3d3-ded43513d460 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:05.641352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c078400a-c073-423b-b3d3-ded43513d460 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:05.649677 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c078400a-c073-423b-b3d3-ded43513d460 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:05.651289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c078400a-c073-423b-b3d3-ded43513d460 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:05.652568 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c078400a-c073-423b-b3d3-ded43513d460 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1727 microversion: 2.20 time: 0.178863 Aug 19 16:39:05.653559 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 522/1038] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:05 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:39:06.674575 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-7ae1fd20-bf2c-4a8b-897c-b19765559038 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:06.675184 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-7ae1fd20-bf2c-4a8b-897c-b19765559038 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:06.681810 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7ae1fd20-bf2c-4a8b-897c-b19765559038 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:06.682293 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7ae1fd20-bf2c-4a8b-897c-b19765559038 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:06.682728 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7ae1fd20-bf2c-4a8b-897c-b19765559038 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:06.684283 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7ae1fd20-bf2c-4a8b-897c-b19765559038 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:06.684700 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7ae1fd20-bf2c-4a8b-897c-b19765559038 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:06.685178 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7ae1fd20-bf2c-4a8b-897c-b19765559038 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:06.814366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7ae1fd20-bf2c-4a8b-897c-b19765559038 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:06.822762 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7ae1fd20-bf2c-4a8b-897c-b19765559038 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:06.824328 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7ae1fd20-bf2c-4a8b-897c-b19765559038 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:06.825495 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-7ae1fd20-bf2c-4a8b-897c-b19765559038 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1727 microversion: 2.20 time: 0.154888 Aug 19 16:39:06.826042 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 517/1039] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:06 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:39:07.848087 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-5ebebfd9-5336-4b30-a434-69ac6639131d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:07.848769 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-5ebebfd9-5336-4b30-a434-69ac6639131d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:07.855886 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5ebebfd9-5336-4b30-a434-69ac6639131d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:07.856361 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5ebebfd9-5336-4b30-a434-69ac6639131d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:07.857085 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5ebebfd9-5336-4b30-a434-69ac6639131d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:07.857781 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5ebebfd9-5336-4b30-a434-69ac6639131d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:07.858242 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5ebebfd9-5336-4b30-a434-69ac6639131d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:07.858669 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5ebebfd9-5336-4b30-a434-69ac6639131d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:08.011724 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-5ebebfd9-5336-4b30-a434-69ac6639131d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:08.019934 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-5ebebfd9-5336-4b30-a434-69ac6639131d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:08.021468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-5ebebfd9-5336-4b30-a434-69ac6639131d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:08.022621 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-5ebebfd9-5336-4b30-a434-69ac6639131d tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1727 microversion: 2.20 time: 0.178547 Aug 19 16:39:08.023169 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 523/1040] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:07 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:39:09.047113 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c763292c-18f9-408c-83ce-980535f130d4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:09.047767 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c763292c-18f9-408c-83ce-980535f130d4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:09.062106 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c763292c-18f9-408c-83ce-980535f130d4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:09.062593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c763292c-18f9-408c-83ce-980535f130d4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:09.063031 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c763292c-18f9-408c-83ce-980535f130d4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:09.063739 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c763292c-18f9-408c-83ce-980535f130d4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:09.064193 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c763292c-18f9-408c-83ce-980535f130d4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:09.064614 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c763292c-18f9-408c-83ce-980535f130d4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:09.237378 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c763292c-18f9-408c-83ce-980535f130d4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:09.250288 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c763292c-18f9-408c-83ce-980535f130d4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:09.251805 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c763292c-18f9-408c-83ce-980535f130d4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:09.253145 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c763292c-18f9-408c-83ce-980535f130d4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1727 microversion: 2.20 time: 0.210313 Aug 19 16:39:09.254036 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 518/1041] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:09 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1727 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:39:10.278913 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-af33b0cc-9176-45f5-a013-516ccf681997 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:10.279553 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-af33b0cc-9176-45f5-a013-516ccf681997 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:10.285966 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-af33b0cc-9176-45f5-a013-516ccf681997 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:10.286449 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-af33b0cc-9176-45f5-a013-516ccf681997 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:10.286886 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-af33b0cc-9176-45f5-a013-516ccf681997 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:10.287575 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-af33b0cc-9176-45f5-a013-516ccf681997 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:10.288030 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-af33b0cc-9176-45f5-a013-516ccf681997 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:10.288456 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-af33b0cc-9176-45f5-a013-516ccf681997 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:10.433371 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-af33b0cc-9176-45f5-a013-516ccf681997 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:10.443925 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-af33b0cc-9176-45f5-a013-516ccf681997 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:10.445885 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-af33b0cc-9176-45f5-a013-516ccf681997 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:10.447286 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-af33b0cc-9176-45f5-a013-516ccf681997 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1727 microversion: 2.20 time: 0.172850 Aug 19 16:39:10.452903 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 524/1042] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:10 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:39:11.471129 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-27bd564a-86f7-4f09-9f14-b6604e7b71a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:11.471728 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-27bd564a-86f7-4f09-9f14-b6604e7b71a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:11.478204 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-27bd564a-86f7-4f09-9f14-b6604e7b71a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:11.478684 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-27bd564a-86f7-4f09-9f14-b6604e7b71a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:11.479116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-27bd564a-86f7-4f09-9f14-b6604e7b71a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:11.480377 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-27bd564a-86f7-4f09-9f14-b6604e7b71a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:11.480852 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-27bd564a-86f7-4f09-9f14-b6604e7b71a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:11.481278 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-27bd564a-86f7-4f09-9f14-b6604e7b71a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:11.644141 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-27bd564a-86f7-4f09-9f14-b6604e7b71a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:11.652470 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-27bd564a-86f7-4f09-9f14-b6604e7b71a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:11.653984 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-27bd564a-86f7-4f09-9f14-b6604e7b71a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:11.655164 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-27bd564a-86f7-4f09-9f14-b6604e7b71a8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1727 microversion: 2.20 time: 0.187879 Aug 19 16:39:11.655707 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 519/1043] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:11 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:39:12.678463 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-5b64bfc9-9434-4a00-ac8e-cad16e85a84f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:12.679150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-5b64bfc9-9434-4a00-ac8e-cad16e85a84f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:12.686611 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5b64bfc9-9434-4a00-ac8e-cad16e85a84f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:12.687087 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5b64bfc9-9434-4a00-ac8e-cad16e85a84f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:12.687518 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5b64bfc9-9434-4a00-ac8e-cad16e85a84f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:12.688354 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5b64bfc9-9434-4a00-ac8e-cad16e85a84f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:12.688839 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5b64bfc9-9434-4a00-ac8e-cad16e85a84f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:12.689260 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5b64bfc9-9434-4a00-ac8e-cad16e85a84f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:12.852109 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-5b64bfc9-9434-4a00-ac8e-cad16e85a84f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:12.861283 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-5b64bfc9-9434-4a00-ac8e-cad16e85a84f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:12.862949 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-5b64bfc9-9434-4a00-ac8e-cad16e85a84f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:12.864129 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-5b64bfc9-9434-4a00-ac8e-cad16e85a84f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1727 microversion: 2.20 time: 0.189556 Aug 19 16:39:12.865184 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 525/1044] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:12 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:39:13.889039 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c05d3e59-3309-464e-8eb1-2e32d9dcaa82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:13.890588 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c05d3e59-3309-464e-8eb1-2e32d9dcaa82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:13.897769 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c05d3e59-3309-464e-8eb1-2e32d9dcaa82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:13.898909 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c05d3e59-3309-464e-8eb1-2e32d9dcaa82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:13.899586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c05d3e59-3309-464e-8eb1-2e32d9dcaa82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:13.900715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c05d3e59-3309-464e-8eb1-2e32d9dcaa82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:13.901571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c05d3e59-3309-464e-8eb1-2e32d9dcaa82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:13.902243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c05d3e59-3309-464e-8eb1-2e32d9dcaa82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:14.034782 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c05d3e59-3309-464e-8eb1-2e32d9dcaa82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:14.043366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c05d3e59-3309-464e-8eb1-2e32d9dcaa82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:14.044881 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c05d3e59-3309-464e-8eb1-2e32d9dcaa82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:14.046043 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c05d3e59-3309-464e-8eb1-2e32d9dcaa82 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1727 microversion: 2.20 time: 0.162106 Aug 19 16:39:14.052994 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 520/1045] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:13 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:39:15.070037 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-55470941-9fc8-4ef2-8dac-14dcba7e4048 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:15.070637 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-55470941-9fc8-4ef2-8dac-14dcba7e4048 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:15.077733 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-55470941-9fc8-4ef2-8dac-14dcba7e4048 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:15.078207 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-55470941-9fc8-4ef2-8dac-14dcba7e4048 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:15.078639 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-55470941-9fc8-4ef2-8dac-14dcba7e4048 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:15.079315 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-55470941-9fc8-4ef2-8dac-14dcba7e4048 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:15.079762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-55470941-9fc8-4ef2-8dac-14dcba7e4048 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:15.080216 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-55470941-9fc8-4ef2-8dac-14dcba7e4048 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:15.211674 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-55470941-9fc8-4ef2-8dac-14dcba7e4048 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:15.219941 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-55470941-9fc8-4ef2-8dac-14dcba7e4048 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:15.221457 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-55470941-9fc8-4ef2-8dac-14dcba7e4048 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:15.222595 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-55470941-9fc8-4ef2-8dac-14dcba7e4048 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1727 microversion: 2.20 time: 0.156780 Aug 19 16:39:15.223145 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 526/1046] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:15 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:39:15.980418 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-7dfdb4ff-cc67-4707-95de-440f6879bd61 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:15.981005 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-7dfdb4ff-cc67-4707-95de-440f6879bd61 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:15.987081 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7dfdb4ff-cc67-4707-95de-440f6879bd61 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:15.987571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7dfdb4ff-cc67-4707-95de-440f6879bd61 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:15.988011 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7dfdb4ff-cc67-4707-95de-440f6879bd61 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:15.988705 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7dfdb4ff-cc67-4707-95de-440f6879bd61 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:15.989195 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7dfdb4ff-cc67-4707-95de-440f6879bd61 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:15.989625 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7dfdb4ff-cc67-4707-95de-440f6879bd61 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:16.013965 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-7dfdb4ff-cc67-4707-95de-440f6879bd61 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/ips" status: 200 len: 147 microversion: 2.1 time: 0.037275 Aug 19 16:39:16.014534 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 521/1047] 10.222.0.55 () {58 vars in 1248 bytes} [Fri Aug 19 16:39:15 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:16.246163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b9625984-12d8-4fe6-aa40-e1bb72b4969e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:16.247459 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-b9625984-12d8-4fe6-aa40-e1bb72b4969e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:16.254693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b9625984-12d8-4fe6-aa40-e1bb72b4969e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:16.255500 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b9625984-12d8-4fe6-aa40-e1bb72b4969e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:16.256160 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b9625984-12d8-4fe6-aa40-e1bb72b4969e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:16.257188 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b9625984-12d8-4fe6-aa40-e1bb72b4969e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:16.257880 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b9625984-12d8-4fe6-aa40-e1bb72b4969e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:16.258793 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b9625984-12d8-4fe6-aa40-e1bb72b4969e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:16.403003 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b9625984-12d8-4fe6-aa40-e1bb72b4969e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:16.412132 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b9625984-12d8-4fe6-aa40-e1bb72b4969e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:16.413651 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b9625984-12d8-4fe6-aa40-e1bb72b4969e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:16.415319 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b9625984-12d8-4fe6-aa40-e1bb72b4969e tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1727 microversion: 2.20 time: 0.173721 Aug 19 16:39:16.415878 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 527/1048] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:16 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:39:17.352277 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e2e61e0b-804f-47d5-b239-4abe90c21faf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21a9d931-5641-43ac-86de-eaeb2d7b19fb"}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:39:17.354826 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e2e61e0b-804f-47d5-b239-4abe90c21faf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:17.361244 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e2e61e0b-804f-47d5-b239-4abe90c21faf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:17.361727 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e2e61e0b-804f-47d5-b239-4abe90c21faf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:17.362166 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e2e61e0b-804f-47d5-b239-4abe90c21faf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:17.362854 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e2e61e0b-804f-47d5-b239-4abe90c21faf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:17.363304 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e2e61e0b-804f-47d5-b239-4abe90c21faf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:17.363729 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e2e61e0b-804f-47d5-b239-4abe90c21faf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:17.438510 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1dba78d0-805c-49d6-b148-e0cd91305ef1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:17.439115 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1dba78d0-805c-49d6-b148-e0cd91305ef1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:17.445997 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1dba78d0-805c-49d6-b148-e0cd91305ef1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:17.446409 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1dba78d0-805c-49d6-b148-e0cd91305ef1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:17.446835 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1dba78d0-805c-49d6-b148-e0cd91305ef1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:17.447514 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1dba78d0-805c-49d6-b148-e0cd91305ef1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:17.448665 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1dba78d0-805c-49d6-b148-e0cd91305ef1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:17.449085 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1dba78d0-805c-49d6-b148-e0cd91305ef1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:17.582455 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1dba78d0-805c-49d6-b148-e0cd91305ef1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:17.590789 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1dba78d0-805c-49d6-b148-e0cd91305ef1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:17.592272 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1dba78d0-805c-49d6-b148-e0cd91305ef1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:17.593444 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1dba78d0-805c-49d6-b148-e0cd91305ef1 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1727 microversion: 2.20 time: 0.158914 Aug 19 16:39:17.593998 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 528/1049] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:17 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:39:17.633648 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e2e61e0b-804f-47d5-b239-4abe90c21faf tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "POST /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285133 Aug 19 16:39:17.634245 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 522/1050] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Aug 19 16:39:17 2022] POST /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:18.030747 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-0dcd6d61-e365-4090-b398-8d8dd6ced18a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:18.031241 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-0dcd6d61-e365-4090-b398-8d8dd6ced18a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:18.037221 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0dcd6d61-e365-4090-b398-8d8dd6ced18a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:18.037699 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0dcd6d61-e365-4090-b398-8d8dd6ced18a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:18.038133 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0dcd6d61-e365-4090-b398-8d8dd6ced18a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:18.038821 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0dcd6d61-e365-4090-b398-8d8dd6ced18a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:18.039276 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0dcd6d61-e365-4090-b398-8d8dd6ced18a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:18.039791 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0dcd6d61-e365-4090-b398-8d8dd6ced18a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:18.062546 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-0dcd6d61-e365-4090-b398-8d8dd6ced18a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/ips" status: 200 len: 150 microversion: 2.1 time: 0.036233 Aug 19 16:39:18.063066 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 529/1051] 10.222.0.55 () {58 vars in 1248 bytes} [Fri Aug 19 16:39:18 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:18.617976 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4301fda2-8fec-4669-b145-5690eae0de92 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:18.618563 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-4301fda2-8fec-4669-b145-5690eae0de92 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:18.625287 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4301fda2-8fec-4669-b145-5690eae0de92 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:18.625741 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4301fda2-8fec-4669-b145-5690eae0de92 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:18.626172 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4301fda2-8fec-4669-b145-5690eae0de92 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:18.626855 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4301fda2-8fec-4669-b145-5690eae0de92 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:18.627301 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4301fda2-8fec-4669-b145-5690eae0de92 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:18.627720 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4301fda2-8fec-4669-b145-5690eae0de92 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:18.771254 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-4301fda2-8fec-4669-b145-5690eae0de92 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:18.779852 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-4301fda2-8fec-4669-b145-5690eae0de92 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:18.781360 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-4301fda2-8fec-4669-b145-5690eae0de92 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:18.782503 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4301fda2-8fec-4669-b145-5690eae0de92 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1727 microversion: 2.20 time: 0.168895 Aug 19 16:39:18.783048 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 523/1052] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:18 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:39:18.837489 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-b1557414-ee79-43b2-8349-951d429db812 req-38699494-f640-4b9a-9261-c4ae69bf7921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf04a2f-684c-4e14-8def-16324168613c", "name": "network-vif-plugged", "status": "completed", "tag": "6f7012e8-b52a-4e31-8e3e-9304cba097fe"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:39:18.848095 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-b1557414-ee79-43b2-8349-951d429db812 req-38699494-f640-4b9a-9261-c4ae69bf7921 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:18.848590 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-b1557414-ee79-43b2-8349-951d429db812 req-38699494-f640-4b9a-9261-c4ae69bf7921 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:18.849051 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-b1557414-ee79-43b2-8349-951d429db812 req-38699494-f640-4b9a-9261-c4ae69bf7921 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:18.860353 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-b1557414-ee79-43b2-8349-951d429db812 req-38699494-f640-4b9a-9261-c4ae69bf7921 service nova] Creating event network-vif-plugged:6f7012e8-b52a-4e31-8e3e-9304cba097fe for instance 5cf04a2f-684c-4e14-8def-16324168613c on hv-cinder-83124 Aug 19 16:39:18.865286 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-b1557414-ee79-43b2-8349-951d429db812 req-38699494-f640-4b9a-9261-c4ae69bf7921 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031592 Aug 19 16:39:18.865870 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 530/1053] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:19.396790 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ada0b959-e368-483b-90e3-4619891461e5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c33b2c99-baa2-4fd8-bf40-330188fd7d65"}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:39:19.399198 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ada0b959-e368-483b-90e3-4619891461e5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:19.405537 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ada0b959-e368-483b-90e3-4619891461e5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:19.406158 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ada0b959-e368-483b-90e3-4619891461e5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:19.406448 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ada0b959-e368-483b-90e3-4619891461e5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:19.407132 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ada0b959-e368-483b-90e3-4619891461e5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:19.407575 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ada0b959-e368-483b-90e3-4619891461e5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:19.408000 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ada0b959-e368-483b-90e3-4619891461e5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:19.718123 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ada0b959-e368-483b-90e3-4619891461e5 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "POST /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324973 Aug 19 16:39:19.718801 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 524/1054] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Aug 19 16:39:19 2022] POST /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:19.806162 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-80c484e0-b350-4055-ba5a-17ea17c96ba4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:19.806894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-80c484e0-b350-4055-ba5a-17ea17c96ba4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:19.814276 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-80c484e0-b350-4055-ba5a-17ea17c96ba4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:19.814837 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-80c484e0-b350-4055-ba5a-17ea17c96ba4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:19.815344 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-80c484e0-b350-4055-ba5a-17ea17c96ba4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:19.816366 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-80c484e0-b350-4055-ba5a-17ea17c96ba4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:19.816925 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-80c484e0-b350-4055-ba5a-17ea17c96ba4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:19.817419 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-80c484e0-b350-4055-ba5a-17ea17c96ba4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:19.952268 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-80c484e0-b350-4055-ba5a-17ea17c96ba4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:19.960450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-80c484e0-b350-4055-ba5a-17ea17c96ba4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:19.961971 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-80c484e0-b350-4055-ba5a-17ea17c96ba4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:19.963119 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-80c484e0-b350-4055-ba5a-17ea17c96ba4 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1727 microversion: 2.20 time: 0.161209 Aug 19 16:39:19.964173 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 531/1055] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:19 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:39:20.988738 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d69c486c-b4da-4010-88bd-bd1a8265b2b6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:20.989462 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d69c486c-b4da-4010-88bd-bd1a8265b2b6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:20.995902 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d69c486c-b4da-4010-88bd-bd1a8265b2b6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:20.996416 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d69c486c-b4da-4010-88bd-bd1a8265b2b6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:20.996880 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d69c486c-b4da-4010-88bd-bd1a8265b2b6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:20.997616 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d69c486c-b4da-4010-88bd-bd1a8265b2b6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:20.998068 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d69c486c-b4da-4010-88bd-bd1a8265b2b6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:20.998491 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d69c486c-b4da-4010-88bd-bd1a8265b2b6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:21.132916 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d69c486c-b4da-4010-88bd-bd1a8265b2b6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:21.141776 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d69c486c-b4da-4010-88bd-bd1a8265b2b6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:21.143269 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d69c486c-b4da-4010-88bd-bd1a8265b2b6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:21.144426 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d69c486c-b4da-4010-88bd-bd1a8265b2b6 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1714 microversion: 2.20 time: 0.160522 Aug 19 16:39:21.145018 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 525/1056] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:20 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1714 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:39:25.170895 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-dcc115f1-02d8-4869-8b7b-45c102b9d825 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:25.173183 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-dcc115f1-02d8-4869-8b7b-45c102b9d825 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:25.179645 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dcc115f1-02d8-4869-8b7b-45c102b9d825 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:25.180123 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dcc115f1-02d8-4869-8b7b-45c102b9d825 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:25.180558 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dcc115f1-02d8-4869-8b7b-45c102b9d825 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:25.181276 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dcc115f1-02d8-4869-8b7b-45c102b9d825 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:25.181763 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dcc115f1-02d8-4869-8b7b-45c102b9d825 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:25.182186 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dcc115f1-02d8-4869-8b7b-45c102b9d825 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:25.211089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-dcc115f1-02d8-4869-8b7b-45c102b9d825 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044601 Aug 19 16:39:25.211568 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 532/1057] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:39:25 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:25.222820 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c30f8232-a12c-46e9-ab75-80a19e579b5f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:25.223300 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c30f8232-a12c-46e9-ab75-80a19e579b5f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:25.230355 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c30f8232-a12c-46e9-ab75-80a19e579b5f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:25.230830 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c30f8232-a12c-46e9-ab75-80a19e579b5f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:25.231265 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c30f8232-a12c-46e9-ab75-80a19e579b5f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:25.231944 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c30f8232-a12c-46e9-ab75-80a19e579b5f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:25.232391 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c30f8232-a12c-46e9-ab75-80a19e579b5f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:25.232838 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c30f8232-a12c-46e9-ab75-80a19e579b5f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:25.261575 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c30f8232-a12c-46e9-ab75-80a19e579b5f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments/21a9d931-5641-43ac-86de-eaeb2d7b19fb" status: 200 len: 194 microversion: 2.1 time: 0.042685 Aug 19 16:39:25.262129 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 526/1058] 10.222.0.55 () {58 vars in 1413 bytes} [Fri Aug 19 16:39:25 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments/21a9d931-5641-43ac-86de-eaeb2d7b19fb => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:26.588349 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-35605256-508a-415a-9c6d-08b96fb98d3f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8369f4f-d4ae-493a-844e-385be41277d5"}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:39:26.591073 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-35605256-508a-415a-9c6d-08b96fb98d3f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:26.597338 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35605256-508a-415a-9c6d-08b96fb98d3f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:26.597813 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35605256-508a-415a-9c6d-08b96fb98d3f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:26.598246 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35605256-508a-415a-9c6d-08b96fb98d3f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:26.598926 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35605256-508a-415a-9c6d-08b96fb98d3f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:26.599380 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35605256-508a-415a-9c6d-08b96fb98d3f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:26.599804 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-35605256-508a-415a-9c6d-08b96fb98d3f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:26.866297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-35605256-508a-415a-9c6d-08b96fb98d3f tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "POST /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281733 Aug 19 16:39:26.866903 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 533/1059] 10.222.0.55 () {60 vars in 1323 bytes} [Fri Aug 19 16:39:26 2022] POST /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:31.568773 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-dd9e7395-e3cc-4edc-840e-1a9ce9aa9220 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:31.569258 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-dd9e7395-e3cc-4edc-840e-1a9ce9aa9220 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:31.571689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=30 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:31.578668 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dd9e7395-e3cc-4edc-840e-1a9ce9aa9220 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:31.579164 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dd9e7395-e3cc-4edc-840e-1a9ce9aa9220 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:31.579598 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dd9e7395-e3cc-4edc-840e-1a9ce9aa9220 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:31.580288 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dd9e7395-e3cc-4edc-840e-1a9ce9aa9220 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:31.580739 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dd9e7395-e3cc-4edc-840e-1a9ce9aa9220 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:31.581182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dd9e7395-e3cc-4edc-840e-1a9ce9aa9220 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:31.583831 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:UPDATE=8,nova_cell1:INSERT=3,nova_cell1:SELECT=85 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:31.664948 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.objects.instance [None req-dd9e7395-e3cc-4edc-840e-1a9ce9aa9220 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lazy-loading 'services' on Instance uuid 586aabe4-766f-4dbd-8f20-b172972323c1 {{(pid=127285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:39:31.737204 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-dd9e7395-e3cc-4edc-840e-1a9ce9aa9220 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "DELETE /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-volume_attachments/c33b2c99-baa2-4fd8-bf40-330188fd7d65" status: 202 len: 0 microversion: 2.1 time: 0.172390 Aug 19 16:39:31.737799 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 527/1060] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Aug 19 16:39:31 2022] DELETE /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-volume_attachments/c33b2c99-baa2-4fd8-bf40-330188fd7d65 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 19 16:39:31.747603 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d1e94c42-c64f-4139-a989-ca62c18273cb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:31.749996 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d1e94c42-c64f-4139-a989-ca62c18273cb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:31.757022 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d1e94c42-c64f-4139-a989-ca62c18273cb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:31.757503 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d1e94c42-c64f-4139-a989-ca62c18273cb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:31.757941 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d1e94c42-c64f-4139-a989-ca62c18273cb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:31.759346 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d1e94c42-c64f-4139-a989-ca62c18273cb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:31.760228 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d1e94c42-c64f-4139-a989-ca62c18273cb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:31.760654 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d1e94c42-c64f-4139-a989-ca62c18273cb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:31.794213 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d1e94c42-c64f-4139-a989-ca62c18273cb tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051683 Aug 19 16:39:31.794769 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 534/1061] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:39:31 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:32.806140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c9490e4e-2e26-41a3-a4b3-331c0147cd2e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:32.809128 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c9490e4e-2e26-41a3-a4b3-331c0147cd2e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:32.815931 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c9490e4e-2e26-41a3-a4b3-331c0147cd2e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:32.816405 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c9490e4e-2e26-41a3-a4b3-331c0147cd2e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:32.816868 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c9490e4e-2e26-41a3-a4b3-331c0147cd2e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:32.817549 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c9490e4e-2e26-41a3-a4b3-331c0147cd2e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:32.817997 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c9490e4e-2e26-41a3-a4b3-331c0147cd2e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:32.818415 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c9490e4e-2e26-41a3-a4b3-331c0147cd2e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:32.846661 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c9490e4e-2e26-41a3-a4b3-331c0147cd2e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044865 Aug 19 16:39:32.847196 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 528/1062] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:39:32 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:33.858933 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ce70b03a-4600-4359-a3de-1dc4cd55562e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:33.861199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ce70b03a-4600-4359-a3de-1dc4cd55562e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:33.863672 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=28 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:33.869480 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ce70b03a-4600-4359-a3de-1dc4cd55562e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:33.869961 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ce70b03a-4600-4359-a3de-1dc4cd55562e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:33.870396 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ce70b03a-4600-4359-a3de-1dc4cd55562e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:33.871087 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ce70b03a-4600-4359-a3de-1dc4cd55562e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:33.871546 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ce70b03a-4600-4359-a3de-1dc4cd55562e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:33.871970 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ce70b03a-4600-4359-a3de-1dc4cd55562e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:33.874544 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=86,nova_cell1:INSERT=2 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:33.904574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ce70b03a-4600-4359-a3de-1dc4cd55562e tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049606 Aug 19 16:39:33.905162 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 535/1063] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:39:33 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:34.917347 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3bb5580e-54f7-484d-88aa-12862327a3ea tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:34.919393 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-3bb5580e-54f7-484d-88aa-12862327a3ea tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:34.925700 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3bb5580e-54f7-484d-88aa-12862327a3ea tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:34.926177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3bb5580e-54f7-484d-88aa-12862327a3ea tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:34.926610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3bb5580e-54f7-484d-88aa-12862327a3ea tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:34.927289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3bb5580e-54f7-484d-88aa-12862327a3ea tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:34.927738 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3bb5580e-54f7-484d-88aa-12862327a3ea tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:34.928155 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3bb5580e-54f7-484d-88aa-12862327a3ea tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:34.956816 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3bb5580e-54f7-484d-88aa-12862327a3ea tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044104 Aug 19 16:39:34.957361 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 529/1064] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:39:34 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:35.969775 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-dda32ee5-3d5f-4fee-b76f-55f9f32ce320 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:35.971845 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-dda32ee5-3d5f-4fee-b76f-55f9f32ce320 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:35.979254 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dda32ee5-3d5f-4fee-b76f-55f9f32ce320 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:35.979736 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dda32ee5-3d5f-4fee-b76f-55f9f32ce320 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:35.980163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dda32ee5-3d5f-4fee-b76f-55f9f32ce320 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:35.980890 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dda32ee5-3d5f-4fee-b76f-55f9f32ce320 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:35.981339 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dda32ee5-3d5f-4fee-b76f-55f9f32ce320 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:35.981758 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-dda32ee5-3d5f-4fee-b76f-55f9f32ce320 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:36.012569 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-dda32ee5-3d5f-4fee-b76f-55f9f32ce320 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047416 Aug 19 16:39:36.013144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 536/1065] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:39:35 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:37.025002 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-559df815-0157-401f-ad2e-9d1963315640 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:37.027176 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-559df815-0157-401f-ad2e-9d1963315640 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:37.033575 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-559df815-0157-401f-ad2e-9d1963315640 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:37.034058 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-559df815-0157-401f-ad2e-9d1963315640 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:37.034491 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-559df815-0157-401f-ad2e-9d1963315640 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:37.035175 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-559df815-0157-401f-ad2e-9d1963315640 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:37.035628 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-559df815-0157-401f-ad2e-9d1963315640 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:37.036046 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-559df815-0157-401f-ad2e-9d1963315640 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:37.064734 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-559df815-0157-401f-ad2e-9d1963315640 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044018 Aug 19 16:39:37.065564 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 530/1066] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:39:37 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:38.078178 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e396b74f-5940-49f9-9d96-62f7fbaba5a0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:38.080355 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-e396b74f-5940-49f9-9d96-62f7fbaba5a0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:38.086872 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e396b74f-5940-49f9-9d96-62f7fbaba5a0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:38.087944 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e396b74f-5940-49f9-9d96-62f7fbaba5a0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:38.088488 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e396b74f-5940-49f9-9d96-62f7fbaba5a0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:38.089238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e396b74f-5940-49f9-9d96-62f7fbaba5a0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:38.089693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e396b74f-5940-49f9-9d96-62f7fbaba5a0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:38.090119 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e396b74f-5940-49f9-9d96-62f7fbaba5a0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:38.120557 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e396b74f-5940-49f9-9d96-62f7fbaba5a0 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046396 Aug 19 16:39:38.121146 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 537/1067] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:39:38 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:38.616157 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6621777c-40b3-482d-a933-ac739ca4f845 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:38.618880 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6621777c-40b3-482d-a933-ac739ca4f845 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:38.625398 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6621777c-40b3-482d-a933-ac739ca4f845 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:38.625885 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6621777c-40b3-482d-a933-ac739ca4f845 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:38.626324 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6621777c-40b3-482d-a933-ac739ca4f845 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:38.627052 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6621777c-40b3-482d-a933-ac739ca4f845 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:38.627504 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6621777c-40b3-482d-a933-ac739ca4f845 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:38.627928 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6621777c-40b3-482d-a933-ac739ca4f845 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:38.658247 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6621777c-40b3-482d-a933-ac739ca4f845 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046081 Aug 19 16:39:38.658806 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 531/1068] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:39:38 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:38.798581 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d7683fa2-6bc1-4e7d-a9f1-3617b7093a76 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:38.799067 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d7683fa2-6bc1-4e7d-a9f1-3617b7093a76 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:38.804954 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d7683fa2-6bc1-4e7d-a9f1-3617b7093a76 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:38.805433 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d7683fa2-6bc1-4e7d-a9f1-3617b7093a76 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:38.806433 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d7683fa2-6bc1-4e7d-a9f1-3617b7093a76 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:38.807215 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d7683fa2-6bc1-4e7d-a9f1-3617b7093a76 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:38.807664 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d7683fa2-6bc1-4e7d-a9f1-3617b7093a76 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:38.808086 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d7683fa2-6bc1-4e7d-a9f1-3617b7093a76 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:38.836048 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d7683fa2-6bc1-4e7d-a9f1-3617b7093a76 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments/21a9d931-5641-43ac-86de-eaeb2d7b19fb" status: 200 len: 194 microversion: 2.1 time: 0.041399 Aug 19 16:39:38.836612 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 538/1069] 10.222.0.55 () {58 vars in 1413 bytes} [Fri Aug 19 16:39:38 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments/21a9d931-5641-43ac-86de-eaeb2d7b19fb => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:38.847181 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a855cefa-54de-4661-a685-1e0fe34c81e0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:38.847680 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a855cefa-54de-4661-a685-1e0fe34c81e0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:38.854176 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a855cefa-54de-4661-a685-1e0fe34c81e0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:38.854659 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a855cefa-54de-4661-a685-1e0fe34c81e0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:38.855098 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a855cefa-54de-4661-a685-1e0fe34c81e0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:38.855783 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a855cefa-54de-4661-a685-1e0fe34c81e0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:38.856241 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a855cefa-54de-4661-a685-1e0fe34c81e0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:38.856671 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a855cefa-54de-4661-a685-1e0fe34c81e0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:38.937267 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.objects.instance [None req-a855cefa-54de-4661-a685-1e0fe34c81e0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lazy-loading 'services' on Instance uuid d99fc027-bd6e-4ba2-9beb-d7277f387542 {{(pid=127285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:39:39.008784 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a855cefa-54de-4661-a685-1e0fe34c81e0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments/21a9d931-5641-43ac-86de-eaeb2d7b19fb" status: 202 len: 0 microversion: 2.1 time: 0.165234 Aug 19 16:39:39.009694 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 532/1070] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Aug 19 16:39:38 2022] DELETE /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments/21a9d931-5641-43ac-86de-eaeb2d7b19fb => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:39:39.132627 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2caf7b0e-b1d1-40f3-a479-cfa33837a53c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:39.135147 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2caf7b0e-b1d1-40f3-a479-cfa33837a53c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:39.141328 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2caf7b0e-b1d1-40f3-a479-cfa33837a53c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:39.141756 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2caf7b0e-b1d1-40f3-a479-cfa33837a53c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:39.142204 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2caf7b0e-b1d1-40f3-a479-cfa33837a53c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:39.142892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2caf7b0e-b1d1-40f3-a479-cfa33837a53c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:39.143346 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2caf7b0e-b1d1-40f3-a479-cfa33837a53c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:39.143774 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2caf7b0e-b1d1-40f3-a479-cfa33837a53c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:39.173571 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2caf7b0e-b1d1-40f3-a479-cfa33837a53c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044795 Aug 19 16:39:39.174129 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 539/1071] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:39:39 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 16:39:39.239240 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e973becb-2669-48ff-85fb-14ece45fde5c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:39.239826 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e973becb-2669-48ff-85fb-14ece45fde5c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:39.246131 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e973becb-2669-48ff-85fb-14ece45fde5c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:39.246611 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e973becb-2669-48ff-85fb-14ece45fde5c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:39.247050 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e973becb-2669-48ff-85fb-14ece45fde5c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:39.247735 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e973becb-2669-48ff-85fb-14ece45fde5c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:39.248187 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e973becb-2669-48ff-85fb-14ece45fde5c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:39.248610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e973becb-2669-48ff-85fb-14ece45fde5c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:39.272429 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e973becb-2669-48ff-85fb-14ece45fde5c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Going to try to terminate instance {{(pid=127285) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:39:39.345963 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e973becb-2669-48ff-85fb-14ece45fde5c tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "DELETE /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1" status: 204 len: 0 microversion: 2.1 time: 0.110673 Aug 19 16:39:39.346544 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 533/1072] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:39:39 2022] DELETE /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:39:39.355318 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a38c3075-9694-4e39-98ba-5e98912c05aa tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:39.355925 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a38c3075-9694-4e39-98ba-5e98912c05aa tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:39.361773 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a38c3075-9694-4e39-98ba-5e98912c05aa tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:39.362242 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a38c3075-9694-4e39-98ba-5e98912c05aa tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:39.362668 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a38c3075-9694-4e39-98ba-5e98912c05aa tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:39.363342 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a38c3075-9694-4e39-98ba-5e98912c05aa tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:39.363786 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a38c3075-9694-4e39-98ba-5e98912c05aa tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:39.364201 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a38c3075-9694-4e39-98ba-5e98912c05aa tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:39.494409 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a38c3075-9694-4e39-98ba-5e98912c05aa tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:39.502189 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a38c3075-9694-4e39-98ba-5e98912c05aa tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1" status: 200 len: 1682 microversion: 2.1 time: 0.151430 Aug 19 16:39:39.502751 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 540/1073] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:39:39 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:39:40.525376 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2d4a6215-4de0-469a-9dcf-a0d15c4c74c7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:40.526086 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2d4a6215-4de0-469a-9dcf-a0d15c4c74c7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:40.532704 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2d4a6215-4de0-469a-9dcf-a0d15c4c74c7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:40.533220 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2d4a6215-4de0-469a-9dcf-a0d15c4c74c7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:40.533680 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2d4a6215-4de0-469a-9dcf-a0d15c4c74c7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:40.534357 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2d4a6215-4de0-469a-9dcf-a0d15c4c74c7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:40.534815 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2d4a6215-4de0-469a-9dcf-a0d15c4c74c7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:40.535244 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2d4a6215-4de0-469a-9dcf-a0d15c4c74c7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:40.670366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2d4a6215-4de0-469a-9dcf-a0d15c4c74c7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:40.677997 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2d4a6215-4de0-469a-9dcf-a0d15c4c74c7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1" status: 200 len: 1682 microversion: 2.1 time: 0.157641 Aug 19 16:39:40.678566 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 534/1074] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:39:40 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:39:41.700835 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-65779e01-475a-4798-8c45-ae1e99ec7644 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:41.701513 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-65779e01-475a-4798-8c45-ae1e99ec7644 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:41.708443 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-65779e01-475a-4798-8c45-ae1e99ec7644 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:41.708951 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-65779e01-475a-4798-8c45-ae1e99ec7644 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:41.709382 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-65779e01-475a-4798-8c45-ae1e99ec7644 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:41.710074 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-65779e01-475a-4798-8c45-ae1e99ec7644 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:41.710521 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-65779e01-475a-4798-8c45-ae1e99ec7644 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:41.710939 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-65779e01-475a-4798-8c45-ae1e99ec7644 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:41.846079 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-65779e01-475a-4798-8c45-ae1e99ec7644 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:41.853972 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-65779e01-475a-4798-8c45-ae1e99ec7644 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1" status: 200 len: 1682 microversion: 2.1 time: 0.158236 Aug 19 16:39:41.854533 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 541/1075] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:39:41 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:39:42.239547 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6d2477a6-9f80-4fd7-bfd9-dbb856186f64 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:42.240066 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6d2477a6-9f80-4fd7-bfd9-dbb856186f64 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:42.247075 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6d2477a6-9f80-4fd7-bfd9-dbb856186f64 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:42.247556 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6d2477a6-9f80-4fd7-bfd9-dbb856186f64 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:42.247990 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6d2477a6-9f80-4fd7-bfd9-dbb856186f64 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:42.248676 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6d2477a6-9f80-4fd7-bfd9-dbb856186f64 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:42.249156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6d2477a6-9f80-4fd7-bfd9-dbb856186f64 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:42.249579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6d2477a6-9f80-4fd7-bfd9-dbb856186f64 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:42.279164 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6d2477a6-9f80-4fd7-bfd9-dbb856186f64 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments/c8369f4f-d4ae-493a-844e-385be41277d5" status: 200 len: 194 microversion: 2.1 time: 0.043546 Aug 19 16:39:42.279759 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 535/1076] 10.222.0.55 () {58 vars in 1413 bytes} [Fri Aug 19 16:39:42 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments/c8369f4f-d4ae-493a-844e-385be41277d5 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:42.290253 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d7a249fd-0414-4786-9c4c-9d64ce7e7f9d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:42.290744 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d7a249fd-0414-4786-9c4c-9d64ce7e7f9d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:42.296625 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d7a249fd-0414-4786-9c4c-9d64ce7e7f9d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:42.297141 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d7a249fd-0414-4786-9c4c-9d64ce7e7f9d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:42.297574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d7a249fd-0414-4786-9c4c-9d64ce7e7f9d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:42.298257 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d7a249fd-0414-4786-9c4c-9d64ce7e7f9d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:42.298705 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d7a249fd-0414-4786-9c4c-9d64ce7e7f9d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:42.299750 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d7a249fd-0414-4786-9c4c-9d64ce7e7f9d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:42.382535 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-ee337439-7b91-490a-b20e-7c46a3a394fd req-aa43b2f2-491d-4bad-a6bf-c561adaebc58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586aabe4-766f-4dbd-8f20-b172972323c1", "name": "network-vif-deleted", "tag": "5b58a247-f105-47de-8142-1b37837daf56"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:39:42.394113 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-ee337439-7b91-490a-b20e-7c46a3a394fd req-aa43b2f2-491d-4bad-a6bf-c561adaebc58 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:42.394822 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-ee337439-7b91-490a-b20e-7c46a3a394fd req-aa43b2f2-491d-4bad-a6bf-c561adaebc58 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:42.395453 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-ee337439-7b91-490a-b20e-7c46a3a394fd req-aa43b2f2-491d-4bad-a6bf-c561adaebc58 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:42.400470 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.objects.instance [None req-d7a249fd-0414-4786-9c4c-9d64ce7e7f9d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lazy-loading 'services' on Instance uuid d99fc027-bd6e-4ba2-9beb-d7277f387542 {{(pid=127284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:39:42.407942 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-ee337439-7b91-490a-b20e-7c46a3a394fd req-aa43b2f2-491d-4bad-a6bf-c561adaebc58 service nova] Creating event network-vif-deleted:5b58a247-f105-47de-8142-1b37837daf56 for instance 586aabe4-766f-4dbd-8f20-b172972323c1 on hv-cinder-83124 Aug 19 16:39:42.412780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-ee337439-7b91-490a-b20e-7c46a3a394fd req-aa43b2f2-491d-4bad-a6bf-c561adaebc58 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033844 Aug 19 16:39:42.416646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 536/1077] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:39:42.493558 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d7a249fd-0414-4786-9c4c-9d64ce7e7f9d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments/c8369f4f-d4ae-493a-844e-385be41277d5" status: 202 len: 0 microversion: 2.1 time: 0.206333 Aug 19 16:39:42.499607 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 542/1078] 10.222.0.55 () {58 vars in 1416 bytes} [Fri Aug 19 16:39:42 2022] DELETE /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments/c8369f4f-d4ae-493a-844e-385be41277d5 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:39:42.876976 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-099c0216-c078-4e5d-8b6f-88b638a439f9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:42.877673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-099c0216-c078-4e5d-8b6f-88b638a439f9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:42.884341 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-099c0216-c078-4e5d-8b6f-88b638a439f9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:42.884853 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-099c0216-c078-4e5d-8b6f-88b638a439f9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:42.885286 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-099c0216-c078-4e5d-8b6f-88b638a439f9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:42.885971 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-099c0216-c078-4e5d-8b6f-88b638a439f9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:42.886416 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-099c0216-c078-4e5d-8b6f-88b638a439f9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:42.886833 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-099c0216-c078-4e5d-8b6f-88b638a439f9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:42.918591 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-099c0216-c078-4e5d-8b6f-88b638a439f9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:42.919178 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-099c0216-c078-4e5d-8b6f-88b638a439f9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:42.919619 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-099c0216-c078-4e5d-8b6f-88b638a439f9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:42.920093 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.objects.instance [None req-099c0216-c078-4e5d-8b6f-88b638a439f9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lazy-loading 'fault' on Instance uuid 586aabe4-766f-4dbd-8f20-b172972323c1 {{(pid=127285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:39:42.965637 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-099c0216-c078-4e5d-8b6f-88b638a439f9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0455ae3ec94c929c940df6a0f6687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1743538991c8415394ac6cd5aed28d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:42.973555 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-099c0216-c078-4e5d-8b6f-88b638a439f9 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1" status: 200 len: 1331 microversion: 2.1 time: 0.100779 Aug 19 16:39:42.974127 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 537/1079] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:39:42 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:39:43.995964 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-80debe61-ad49-4ff5-8491-54d9354dae61 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:43.996656 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-80debe61-ad49-4ff5-8491-54d9354dae61 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:44.003375 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-80debe61-ad49-4ff5-8491-54d9354dae61 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:44.003848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-80debe61-ad49-4ff5-8491-54d9354dae61 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:44.004275 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-80debe61-ad49-4ff5-8491-54d9354dae61 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:44.004985 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-80debe61-ad49-4ff5-8491-54d9354dae61 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:44.005434 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-80debe61-ad49-4ff5-8491-54d9354dae61 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:44.005856 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-80debe61-ad49-4ff5-8491-54d9354dae61 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:44.019528 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-80debe61-ad49-4ff5-8491-54d9354dae61 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] HTTP exception thrown: Instance 586aabe4-766f-4dbd-8f20-b172972323c1 could not be found. Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-80debe61-ad49-4ff5-8491-54d9354dae61 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Request method failure captured: Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 HTTP/1.1 Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7sAw9LcxO6N0pZY1nhZLJGTFHO5NOhvu1eVk6xTEodx-7uYGCVFosqHM2vYV2yCCDgERTbLEbTufj2duylmwK82XOJGkc69LfohAu5wx0GlI5NYAoHX6aVSGY0q6pl5_M_R0V-WnUvH1N5W6DXSAAPQV7ymDnRnchpgyuPHrFewp9k Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:39:44.021150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:39:44.022764 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1743538991c8415394ac6cd5aed28d6a"}]}] Aug 19 16:39:44.022764 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:44.022764 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:39:44.022764 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:44.022764 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:39:44.022764 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:39:44.022764 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:39:44.022764 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: 9b0455ae3ec94c929c940df6a0f6687d Aug 19 16:39:44.022764 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:39:44.022764 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:39:44.022764 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance 586aabe4-766f-4dbd-8f20-b172972323c1 could not be found. Aug 19 16:39:44.022764 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': '586aabe4-766f-4dbd-8f20-b172972323c1'} Aug 19 16:39:44.023838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:39:44.023838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:44.023838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:39:44.023838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:39:44.023838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:39:44.023838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:39:44.023838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:39:44.023838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:39:44.023838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:39:44.023838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:39:44.023838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 586aabe4-766f-4dbd-8f20-b172972323c1 could not be found. Aug 19 16:39:44.023838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:44.023838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:44.023838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:44.023838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:44.023838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:44.023838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:44.023838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:39:44.023838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:39:44.023838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:39:44.026356 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:39:44.026356 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:39:44.026356 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:39:44.026356 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:39:44.026356 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:39:44.026356 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:39:44.026356 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:39:44.026356 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 586aabe4-766f-4dbd-8f20-b172972323c1 could not be found. Aug 19 16:39:44.026356 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:44.026356 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:44.026356 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:44.026356 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:44.026356 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:44.026356 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:44.026356 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:39:44.026356 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:39:44.026356 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 586aabe4-766f-4dbd-8f20-b172972323c1 could not be found. Aug 19 16:39:44.026356 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:44.028070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-80debe61-ad49-4ff5-8491-54d9354dae61 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Returning 404 to user: Instance 586aabe4-766f-4dbd-8f20-b172972323c1 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:39:44.028070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-80debe61-ad49-4ff5-8491-54d9354dae61 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1" status: 404 len: 111 microversion: 2.1 time: 0.031209 Aug 19 16:39:44.028070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 543/1080] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:39:43 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:39:44.032140 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4d95f62a-873b-47a5-89d7-299daa935ad8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '.version_select at 0x7fb01e092dc0>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:44.050382 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4d95f62a-873b-47a5-89d7-299daa935ad8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1515338577" status: 202 len: 0 microversion: 2.1 time: 0.022104 Aug 19 16:39:44.050939 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 538/1081] 10.222.0.55 () {58 vars in 1221 bytes} [Fri Aug 19 16:39:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1515338577 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:39:44.752544 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-92a4493a-92ea-47b5-9236-46743dc5d605 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:44.754820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-92a4493a-92ea-47b5-9236-46743dc5d605 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:44.761203 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-92a4493a-92ea-47b5-9236-46743dc5d605 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:44.761675 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-92a4493a-92ea-47b5-9236-46743dc5d605 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:44.762106 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-92a4493a-92ea-47b5-9236-46743dc5d605 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:44.762780 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-92a4493a-92ea-47b5-9236-46743dc5d605 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:44.763232 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-92a4493a-92ea-47b5-9236-46743dc5d605 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:44.764494 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-92a4493a-92ea-47b5-9236-46743dc5d605 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:44.801579 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-92a4493a-92ea-47b5-9236-46743dc5d605 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053056 Aug 19 16:39:44.802128 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 544/1082] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:39:44 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 19 16:39:44.913021 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-74aa1320-8804-4a3b-9227-edd608cb06f6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:44.915776 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-74aa1320-8804-4a3b-9227-edd608cb06f6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:44.922386 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-74aa1320-8804-4a3b-9227-edd608cb06f6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:44.922866 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-74aa1320-8804-4a3b-9227-edd608cb06f6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:44.923299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-74aa1320-8804-4a3b-9227-edd608cb06f6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:44.923985 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-74aa1320-8804-4a3b-9227-edd608cb06f6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:44.924433 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-74aa1320-8804-4a3b-9227-edd608cb06f6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:44.924888 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-74aa1320-8804-4a3b-9227-edd608cb06f6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:44.955602 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-74aa1320-8804-4a3b-9227-edd608cb06f6 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046555 Aug 19 16:39:44.956257 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 539/1083] 10.222.0.55 () {58 vars in 1302 bytes} [Fri Aug 19 16:39:44 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 16:39:45.019166 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1586a7e9-3b45-4dab-988a-e956329990ec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:45.019689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1586a7e9-3b45-4dab-988a-e956329990ec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:45.026104 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1586a7e9-3b45-4dab-988a-e956329990ec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:45.026588 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1586a7e9-3b45-4dab-988a-e956329990ec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:45.027026 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1586a7e9-3b45-4dab-988a-e956329990ec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:45.027713 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1586a7e9-3b45-4dab-988a-e956329990ec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:45.028172 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1586a7e9-3b45-4dab-988a-e956329990ec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:45.028603 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1586a7e9-3b45-4dab-988a-e956329990ec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:45.056660 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1586a7e9-3b45-4dab-988a-e956329990ec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Going to try to terminate instance {{(pid=127284) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:39:45.129982 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1586a7e9-3b45-4dab-988a-e956329990ec tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542" status: 204 len: 0 microversion: 2.1 time: 0.114248 Aug 19 16:39:45.130599 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 545/1084] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:39:45 2022] DELETE /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 19 16:39:45.139300 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b0af332a-52f7-417a-bd0e-ff3e8a64bf6b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:45.139916 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b0af332a-52f7-417a-bd0e-ff3e8a64bf6b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:45.146243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b0af332a-52f7-417a-bd0e-ff3e8a64bf6b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:45.146732 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b0af332a-52f7-417a-bd0e-ff3e8a64bf6b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:45.147172 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b0af332a-52f7-417a-bd0e-ff3e8a64bf6b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:45.147862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b0af332a-52f7-417a-bd0e-ff3e8a64bf6b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:45.148320 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b0af332a-52f7-417a-bd0e-ff3e8a64bf6b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:45.148785 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b0af332a-52f7-417a-bd0e-ff3e8a64bf6b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:45.281202 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b0af332a-52f7-417a-bd0e-ff3e8a64bf6b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:45.288746 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b0af332a-52f7-417a-bd0e-ff3e8a64bf6b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542" status: 200 len: 1675 microversion: 2.1 time: 0.153446 Aug 19 16:39:45.289322 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 540/1085] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:39:45 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:39:45.778137 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-eb3ff593-25a6-4629-ad48-aba60dd036df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:45.778722 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-eb3ff593-25a6-4629-ad48-aba60dd036df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:45.784498 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-eb3ff593-25a6-4629-ad48-aba60dd036df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:45.785009 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-eb3ff593-25a6-4629-ad48-aba60dd036df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:45.785444 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-eb3ff593-25a6-4629-ad48-aba60dd036df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:45.786119 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-eb3ff593-25a6-4629-ad48-aba60dd036df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:45.786564 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-eb3ff593-25a6-4629-ad48-aba60dd036df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:45.786981 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-eb3ff593-25a6-4629-ad48-aba60dd036df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:45.799911 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-eb3ff593-25a6-4629-ad48-aba60dd036df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] HTTP exception thrown: Instance 586aabe4-766f-4dbd-8f20-b172972323c1 could not be found. Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-eb3ff593-25a6-4629-ad48-aba60dd036df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Request method failure captured: Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: DELETE /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 HTTP/1.1 Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7sAw9LcxO6N0pZY1nhZLJGTFHO5NOhvu1eVk6xTEodx-7uYGCVFosqHM2vYV2yCCDgERTbLEbTufj2duylmwK82XOJGkc69LfohAu5wx0GlI5NYAoHX6aVSGY0q6pl5_M_R0V-WnUvH1N5W6DXSAAPQV7ymDnRnchpgyuPHrFewp9k Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:39:45.801573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:39:45.803185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1743538991c8415394ac6cd5aed28d6a"}]}] Aug 19 16:39:45.803185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:45.803185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:39:45.803185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:45.803185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:39:45.803185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:39:45.803185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:39:45.803185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: 9b0455ae3ec94c929c940df6a0f6687d Aug 19 16:39:45.803185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:39:45.803185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:39:45.803185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance 586aabe4-766f-4dbd-8f20-b172972323c1 could not be found. Aug 19 16:39:45.803185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': '586aabe4-766f-4dbd-8f20-b172972323c1'} Aug 19 16:39:45.803990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:39:45.803990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:45.803990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:39:45.803990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:39:45.803990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:39:45.803990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:39:45.803990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:39:45.803990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:39:45.803990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:39:45.803990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:39:45.803990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 586aabe4-766f-4dbd-8f20-b172972323c1 could not be found. Aug 19 16:39:45.803990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:45.803990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:45.803990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:45.803990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:45.803990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:45.803990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:45.803990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:39:45.803990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:39:45.803990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:39:45.805359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:39:45.805359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 16:39:45.805359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 16:39:45.805359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 16:39:45.805359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 16:39:45.805359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:39:45.805359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:39:45.805359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:39:45.805359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:39:45.805359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 586aabe4-766f-4dbd-8f20-b172972323c1 could not be found. Aug 19 16:39:45.805359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:45.805359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:45.805359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:45.805359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:45.805359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:45.805359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:45.805359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:39:45.805359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:39:45.805359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 586aabe4-766f-4dbd-8f20-b172972323c1 could not be found. Aug 19 16:39:45.805359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:45.806598 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-eb3ff593-25a6-4629-ad48-aba60dd036df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Returning 404 to user: Instance 586aabe4-766f-4dbd-8f20-b172972323c1 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:39:45.806598 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-eb3ff593-25a6-4629-ad48-aba60dd036df tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "DELETE /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1" status: 404 len: 111 microversion: 2.1 time: 0.029876 Aug 19 16:39:45.806598 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 546/1086] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:39:45 2022] DELETE /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:39:45.811400 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c73ada4e-5081-4ebb-ab18-4a54cccd91be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:45.812009 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c73ada4e-5081-4ebb-ab18-4a54cccd91be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 586aabe4-766f-4dbd-8f20-b172972323c1] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:45.818049 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c73ada4e-5081-4ebb-ab18-4a54cccd91be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:45.818522 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c73ada4e-5081-4ebb-ab18-4a54cccd91be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:45.818951 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c73ada4e-5081-4ebb-ab18-4a54cccd91be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:45.819625 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c73ada4e-5081-4ebb-ab18-4a54cccd91be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:45.820072 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c73ada4e-5081-4ebb-ab18-4a54cccd91be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:45.820489 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c73ada4e-5081-4ebb-ab18-4a54cccd91be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:45.833771 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-c73ada4e-5081-4ebb-ab18-4a54cccd91be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] HTTP exception thrown: Instance 586aabe4-766f-4dbd-8f20-b172972323c1 could not be found. Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c73ada4e-5081-4ebb-ab18-4a54cccd91be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Request method failure captured: Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 HTTP/1.1 Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7sAw9LcxO6N0pZY1nhZLJGTFHO5NOhvu1eVk6xTEodx-7uYGCVFosqHM2vYV2yCCDgERTbLEbTufj2duylmwK82XOJGkc69LfohAu5wx0GlI5NYAoHX6aVSGY0q6pl5_M_R0V-WnUvH1N5W6DXSAAPQV7ymDnRnchpgyuPHrFewp9k Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:39:45.835390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:39:45.837579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1743538991c8415394ac6cd5aed28d6a"}]}] Aug 19 16:39:45.837579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:45.837579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:39:45.837579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:45.837579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:39:45.837579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:39:45.837579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:39:45.837579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: 9b0455ae3ec94c929c940df6a0f6687d Aug 19 16:39:45.837579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:39:45.837579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:39:45.837579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance 586aabe4-766f-4dbd-8f20-b172972323c1 could not be found. Aug 19 16:39:45.837579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': '586aabe4-766f-4dbd-8f20-b172972323c1'} Aug 19 16:39:45.838407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:39:45.838407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:45.838407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:39:45.838407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:39:45.838407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:39:45.838407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:39:45.838407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:39:45.838407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:39:45.838407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:39:45.838407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:39:45.838407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 586aabe4-766f-4dbd-8f20-b172972323c1 could not be found. Aug 19 16:39:45.838407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:45.838407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:45.838407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:45.838407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:45.838407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:45.838407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:45.838407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:39:45.838407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:39:45.838407 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:39:45.839788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:39:45.839788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:39:45.839788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:39:45.839788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:39:45.839788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:39:45.839788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:39:45.839788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:39:45.839788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 586aabe4-766f-4dbd-8f20-b172972323c1 could not be found. Aug 19 16:39:45.839788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:45.839788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:45.839788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:45.839788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:45.839788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:45.839788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:45.839788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:39:45.839788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:39:45.839788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 586aabe4-766f-4dbd-8f20-b172972323c1 could not be found. Aug 19 16:39:45.839788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:45.841095 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c73ada4e-5081-4ebb-ab18-4a54cccd91be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Returning 404 to user: Instance 586aabe4-766f-4dbd-8f20-b172972323c1 could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:39:45.841095 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c73ada4e-5081-4ebb-ab18-4a54cccd91be tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1" status: 404 len: 111 microversion: 2.1 time: 0.029213 Aug 19 16:39:45.841095 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 541/1087] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:39:45 2022] GET /compute/v2.1/servers/586aabe4-766f-4dbd-8f20-b172972323c1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 16:39:46.311531 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d4b91b6e-0ed9-4686-9ee3-695cd0c52f0d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:46.312113 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d4b91b6e-0ed9-4686-9ee3-695cd0c52f0d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:46.318812 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d4b91b6e-0ed9-4686-9ee3-695cd0c52f0d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:46.319290 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d4b91b6e-0ed9-4686-9ee3-695cd0c52f0d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:46.319765 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d4b91b6e-0ed9-4686-9ee3-695cd0c52f0d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:46.320452 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d4b91b6e-0ed9-4686-9ee3-695cd0c52f0d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:46.321184 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d4b91b6e-0ed9-4686-9ee3-695cd0c52f0d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:46.321636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d4b91b6e-0ed9-4686-9ee3-695cd0c52f0d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:46.450325 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d4b91b6e-0ed9-4686-9ee3-695cd0c52f0d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:46.457955 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d4b91b6e-0ed9-4686-9ee3-695cd0c52f0d tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542" status: 200 len: 1675 microversion: 2.1 time: 0.150395 Aug 19 16:39:46.458500 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 547/1088] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:39:46 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:39:46.977385 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3a2d2b6e-d5be-4bd2-9746-21075b30e5a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:46.977881 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-3a2d2b6e-d5be-4bd2-9746-21075b30e5a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:46.984184 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3a2d2b6e-d5be-4bd2-9746-21075b30e5a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:46.984655 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3a2d2b6e-d5be-4bd2-9746-21075b30e5a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:46.985116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3a2d2b6e-d5be-4bd2-9746-21075b30e5a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:46.985799 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3a2d2b6e-d5be-4bd2-9746-21075b30e5a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:46.986246 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3a2d2b6e-d5be-4bd2-9746-21075b30e5a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:46.986665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3a2d2b6e-d5be-4bd2-9746-21075b30e5a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:47.000792 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-3a2d2b6e-d5be-4bd2-9746-21075b30e5a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] HTTP exception thrown: Instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e could not be found. Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3a2d2b6e-d5be-4bd2-9746-21075b30e5a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Request method failure captured: Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: DELETE /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e HTTP/1.1 Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7sAw9LcxO6N0pZY1nhZLJGTFHO5NOhvu1eVk6xTEodx-7uYGCVFosqHM2vYV2yCCDgERTbLEbTufj2duylmwK82XOJGkc69LfohAu5wx0GlI5NYAoHX6aVSGY0q6pl5_M_R0V-WnUvH1N5W6DXSAAPQV7ymDnRnchpgyuPHrFewp9k Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:39:47.002338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:39:47.003883 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1743538991c8415394ac6cd5aed28d6a"}]}] Aug 19 16:39:47.003883 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:47.003883 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:39:47.003883 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:47.003883 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:39:47.003883 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:39:47.003883 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:39:47.003883 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: 9b0455ae3ec94c929c940df6a0f6687d Aug 19 16:39:47.003883 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:39:47.003883 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:39:47.003883 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e could not be found. Aug 19 16:39:47.003883 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': '171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e'} Aug 19 16:39:47.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:39:47.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:47.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:39:47.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:39:47.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:39:47.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:39:47.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:39:47.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:39:47.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:39:47.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:39:47.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e could not be found. Aug 19 16:39:47.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:47.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:47.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:47.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:47.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:47.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:47.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:39:47.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:39:47.004665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:39:47.006057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:39:47.006057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 16:39:47.006057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 16:39:47.006057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 16:39:47.006057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 16:39:47.006057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:39:47.006057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:39:47.006057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:39:47.006057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:39:47.006057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e could not be found. Aug 19 16:39:47.006057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:47.006057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:47.006057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:47.006057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:47.006057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:47.006057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:47.006057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:39:47.006057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:39:47.006057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e could not be found. Aug 19 16:39:47.006057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:47.007449 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3a2d2b6e-d5be-4bd2-9746-21075b30e5a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Returning 404 to user: Instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:39:47.007449 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3a2d2b6e-d5be-4bd2-9746-21075b30e5a8 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "DELETE /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 404 len: 111 microversion: 2.1 time: 0.030195 Aug 19 16:39:47.007449 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 542/1089] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:39:46 2022] DELETE /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:39:47.012837 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b47c1998-adf9-4476-8665-308819c9c604 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:47.013447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-b47c1998-adf9-4476-8665-308819c9c604 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:47.019302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b47c1998-adf9-4476-8665-308819c9c604 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:47.019848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b47c1998-adf9-4476-8665-308819c9c604 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:47.020288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b47c1998-adf9-4476-8665-308819c9c604 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:47.020998 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b47c1998-adf9-4476-8665-308819c9c604 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:47.021449 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b47c1998-adf9-4476-8665-308819c9c604 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:47.021871 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b47c1998-adf9-4476-8665-308819c9c604 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:47.034853 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-b47c1998-adf9-4476-8665-308819c9c604 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] HTTP exception thrown: Instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e could not be found. Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b47c1998-adf9-4476-8665-308819c9c604 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Request method failure captured: Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e HTTP/1.1 Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7sAw9LcxO6N0pZY1nhZLJGTFHO5NOhvu1eVk6xTEodx-7uYGCVFosqHM2vYV2yCCDgERTbLEbTufj2duylmwK82XOJGkc69LfohAu5wx0GlI5NYAoHX6aVSGY0q6pl5_M_R0V-WnUvH1N5W6DXSAAPQV7ymDnRnchpgyuPHrFewp9k Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:39:47.036387 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:39:47.038033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1743538991c8415394ac6cd5aed28d6a"}]}] Aug 19 16:39:47.038033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:47.038033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:39:47.038033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:47.038033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:39:47.038033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:39:47.038033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:39:47.038033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: 9b0455ae3ec94c929c940df6a0f6687d Aug 19 16:39:47.038033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:39:47.038033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:39:47.038033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e could not be found. Aug 19 16:39:47.038033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': '171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e'} Aug 19 16:39:47.039044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:39:47.039044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:47.039044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:39:47.039044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:39:47.039044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:39:47.039044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:39:47.039044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:39:47.039044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:39:47.039044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:39:47.039044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:39:47.039044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e could not be found. Aug 19 16:39:47.039044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:47.039044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:47.039044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:47.039044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:47.039044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:47.039044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:47.039044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:39:47.039044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:39:47.039044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:39:47.041140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:39:47.041140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:39:47.041140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:39:47.041140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:39:47.041140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:39:47.041140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:39:47.041140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:39:47.041140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e could not be found. Aug 19 16:39:47.041140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:47.041140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:47.041140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:47.041140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:47.041140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:47.041140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:47.041140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:39:47.041140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:39:47.041140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e could not be found. Aug 19 16:39:47.041140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:47.042413 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b47c1998-adf9-4476-8665-308819c9c604 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Returning 404 to user: Instance 171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:39:47.042413 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b47c1998-adf9-4476-8665-308819c9c604 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e" status: 404 len: 111 microversion: 2.1 time: 0.029580 Aug 19 16:39:47.042413 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 548/1090] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:39:47 2022] GET /compute/v2.1/servers/171a74a9-8d3c-45ff-9ef2-cd62bc3e2d6e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:39:47.046426 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-63a13d33-aaec-4f0b-8674-fb816cfbdb36 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:47.046921 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-63a13d33-aaec-4f0b-8674-fb816cfbdb36 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:47.052859 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-63a13d33-aaec-4f0b-8674-fb816cfbdb36 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:47.053333 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-63a13d33-aaec-4f0b-8674-fb816cfbdb36 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:47.053763 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-63a13d33-aaec-4f0b-8674-fb816cfbdb36 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:47.054442 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-63a13d33-aaec-4f0b-8674-fb816cfbdb36 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:47.054890 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-63a13d33-aaec-4f0b-8674-fb816cfbdb36 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:47.055901 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-63a13d33-aaec-4f0b-8674-fb816cfbdb36 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:47.070905 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-63a13d33-aaec-4f0b-8674-fb816cfbdb36 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] HTTP exception thrown: Instance 66209407-a95b-4602-8c4c-b00baa5104e3 could not be found. Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-63a13d33-aaec-4f0b-8674-fb816cfbdb36 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Request method failure captured: Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: DELETE /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 HTTP/1.1 Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7sAw9LcxO6N0pZY1nhZLJGTFHO5NOhvu1eVk6xTEodx-7uYGCVFosqHM2vYV2yCCDgERTbLEbTufj2duylmwK82XOJGkc69LfohAu5wx0GlI5NYAoHX6aVSGY0q6pl5_M_R0V-WnUvH1N5W6DXSAAPQV7ymDnRnchpgyuPHrFewp9k Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:39:47.072430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:39:47.074263 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1743538991c8415394ac6cd5aed28d6a"}]}] Aug 19 16:39:47.074263 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:47.074263 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:39:47.074263 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:47.074263 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:39:47.074263 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:39:47.074263 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:39:47.074263 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: 9b0455ae3ec94c929c940df6a0f6687d Aug 19 16:39:47.074263 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:39:47.074263 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:39:47.074263 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance 66209407-a95b-4602-8c4c-b00baa5104e3 could not be found. Aug 19 16:39:47.074263 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': '66209407-a95b-4602-8c4c-b00baa5104e3'} Aug 19 16:39:47.075151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:39:47.075151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:47.075151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:39:47.075151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:39:47.075151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:39:47.075151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:39:47.075151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:39:47.075151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:39:47.075151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:39:47.075151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:39:47.075151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66209407-a95b-4602-8c4c-b00baa5104e3 could not be found. Aug 19 16:39:47.075151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:47.075151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:47.075151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:47.075151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:47.075151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:47.075151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:47.075151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:39:47.075151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:39:47.075151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:39:47.076593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:39:47.076593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 16:39:47.076593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 16:39:47.076593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 16:39:47.076593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 16:39:47.076593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:39:47.076593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:39:47.076593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:39:47.076593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:39:47.076593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66209407-a95b-4602-8c4c-b00baa5104e3 could not be found. Aug 19 16:39:47.076593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:47.076593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:47.076593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:47.076593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:47.076593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:47.076593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:47.076593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:39:47.076593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:39:47.076593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66209407-a95b-4602-8c4c-b00baa5104e3 could not be found. Aug 19 16:39:47.076593 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:47.078350 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-63a13d33-aaec-4f0b-8674-fb816cfbdb36 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Returning 404 to user: Instance 66209407-a95b-4602-8c4c-b00baa5104e3 could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:39:47.078350 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-63a13d33-aaec-4f0b-8674-fb816cfbdb36 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "DELETE /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 404 len: 111 microversion: 2.1 time: 0.031219 Aug 19 16:39:47.078350 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 543/1091] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:39:47 2022] DELETE /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:39:47.081960 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-0a145f4e-e43a-42ab-80d1-eac81071d46a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:47.082571 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-0a145f4e-e43a-42ab-80d1-eac81071d46a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 66209407-a95b-4602-8c4c-b00baa5104e3] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:47.088439 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0a145f4e-e43a-42ab-80d1-eac81071d46a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:47.088953 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0a145f4e-e43a-42ab-80d1-eac81071d46a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:47.089390 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0a145f4e-e43a-42ab-80d1-eac81071d46a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:47.090073 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0a145f4e-e43a-42ab-80d1-eac81071d46a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:47.090521 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0a145f4e-e43a-42ab-80d1-eac81071d46a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:47.090941 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0a145f4e-e43a-42ab-80d1-eac81071d46a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:47.104447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-0a145f4e-e43a-42ab-80d1-eac81071d46a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] HTTP exception thrown: Instance 66209407-a95b-4602-8c4c-b00baa5104e3 could not be found. Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-0a145f4e-e43a-42ab-80d1-eac81071d46a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Request method failure captured: Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 HTTP/1.1 Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7sAw9LcxO6N0pZY1nhZLJGTFHO5NOhvu1eVk6xTEodx-7uYGCVFosqHM2vYV2yCCDgERTbLEbTufj2duylmwK82XOJGkc69LfohAu5wx0GlI5NYAoHX6aVSGY0q6pl5_M_R0V-WnUvH1N5W6DXSAAPQV7ymDnRnchpgyuPHrFewp9k Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:39:47.105973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:39:47.107525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1743538991c8415394ac6cd5aed28d6a"}]}] Aug 19 16:39:47.107525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:47.107525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:39:47.107525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:47.107525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:39:47.107525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:39:47.107525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:39:47.107525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: 9b0455ae3ec94c929c940df6a0f6687d Aug 19 16:39:47.107525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:39:47.107525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:39:47.107525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance 66209407-a95b-4602-8c4c-b00baa5104e3 could not be found. Aug 19 16:39:47.107525 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': '66209407-a95b-4602-8c4c-b00baa5104e3'} Aug 19 16:39:47.108398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:39:47.108398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:47.108398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:39:47.108398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:39:47.108398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:39:47.108398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:39:47.108398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:39:47.108398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:39:47.108398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:39:47.108398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:39:47.108398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66209407-a95b-4602-8c4c-b00baa5104e3 could not be found. Aug 19 16:39:47.108398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:47.108398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:47.108398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:47.108398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:47.108398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:47.108398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:47.108398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:39:47.108398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:39:47.108398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:39:47.109876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:39:47.109876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:39:47.109876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:39:47.109876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:39:47.109876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:39:47.109876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:39:47.109876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:39:47.109876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66209407-a95b-4602-8c4c-b00baa5104e3 could not be found. Aug 19 16:39:47.109876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:47.109876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:47.109876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:47.109876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:47.109876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:47.109876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:47.109876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:39:47.109876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:39:47.109876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66209407-a95b-4602-8c4c-b00baa5104e3 could not be found. Aug 19 16:39:47.109876 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:47.111144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-0a145f4e-e43a-42ab-80d1-eac81071d46a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Returning 404 to user: Instance 66209407-a95b-4602-8c4c-b00baa5104e3 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:39:47.111144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-0a145f4e-e43a-42ab-80d1-eac81071d46a tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3" status: 404 len: 111 microversion: 2.1 time: 0.029123 Aug 19 16:39:47.111144 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 549/1092] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:39:47 2022] GET /compute/v2.1/servers/66209407-a95b-4602-8c4c-b00baa5104e3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:39:47.480217 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e11726ce-266f-43ee-b56a-b87b77e8905c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:47.480848 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e11726ce-266f-43ee-b56a-b87b77e8905c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:47.487065 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e11726ce-266f-43ee-b56a-b87b77e8905c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:47.487549 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e11726ce-266f-43ee-b56a-b87b77e8905c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:47.488019 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e11726ce-266f-43ee-b56a-b87b77e8905c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:47.488893 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e11726ce-266f-43ee-b56a-b87b77e8905c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:47.489251 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e11726ce-266f-43ee-b56a-b87b77e8905c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:47.489706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e11726ce-266f-43ee-b56a-b87b77e8905c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:47.494192 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:47.701224 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e11726ce-266f-43ee-b56a-b87b77e8905c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:47.708953 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e11726ce-266f-43ee-b56a-b87b77e8905c tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542" status: 200 len: 1675 microversion: 2.1 time: 0.233542 Aug 19 16:39:47.709506 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 544/1093] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:39:47 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 => generated 1675 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:39:48.247768 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a5dba646-1f12-41f5-b1c2-7216e9384a93 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:48.248292 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a5dba646-1f12-41f5-b1c2-7216e9384a93 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:48.254665 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a5dba646-1f12-41f5-b1c2-7216e9384a93 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:48.255139 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a5dba646-1f12-41f5-b1c2-7216e9384a93 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:48.255573 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a5dba646-1f12-41f5-b1c2-7216e9384a93 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:48.256257 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a5dba646-1f12-41f5-b1c2-7216e9384a93 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:48.256704 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a5dba646-1f12-41f5-b1c2-7216e9384a93 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:48.257146 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a5dba646-1f12-41f5-b1c2-7216e9384a93 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:48.271265 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-a5dba646-1f12-41f5-b1c2-7216e9384a93 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] HTTP exception thrown: Instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 could not be found. Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a5dba646-1f12-41f5-b1c2-7216e9384a93 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Request method failure captured: Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: DELETE /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 HTTP/1.1 Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7sAw9LcxO6N0pZY1nhZLJGTFHO5NOhvu1eVk6xTEodx-7uYGCVFosqHM2vYV2yCCDgERTbLEbTufj2duylmwK82XOJGkc69LfohAu5wx0GlI5NYAoHX6aVSGY0q6pl5_M_R0V-WnUvH1N5W6DXSAAPQV7ymDnRnchpgyuPHrFewp9k Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:39:48.272831 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:39:48.274477 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1743538991c8415394ac6cd5aed28d6a"}]}] Aug 19 16:39:48.274477 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:48.274477 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:39:48.274477 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:48.274477 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:39:48.274477 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:39:48.274477 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:39:48.274477 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: 9b0455ae3ec94c929c940df6a0f6687d Aug 19 16:39:48.274477 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:39:48.274477 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:39:48.274477 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 could not be found. Aug 19 16:39:48.274477 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': '9f1f3d4e-7c83-4d2b-a34f-4cac4b871285'} Aug 19 16:39:48.275273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:39:48.275273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:48.275273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:39:48.275273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:39:48.275273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:39:48.275273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:39:48.275273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:39:48.275273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:39:48.275273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:39:48.275273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:39:48.275273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 could not be found. Aug 19 16:39:48.275273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:48.275273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:48.275273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:48.275273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:48.275273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:48.275273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:48.275273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:39:48.275273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:39:48.275273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:39:48.276554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:39:48.276554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 16:39:48.276554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 16:39:48.276554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 16:39:48.276554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 16:39:48.276554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:39:48.276554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:39:48.276554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:39:48.276554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:39:48.276554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 could not be found. Aug 19 16:39:48.276554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:48.276554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:48.276554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:48.276554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:48.276554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:48.276554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:48.276554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:39:48.276554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:39:48.276554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 could not be found. Aug 19 16:39:48.276554 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:48.278140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a5dba646-1f12-41f5-b1c2-7216e9384a93 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Returning 404 to user: Instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:39:48.278140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a5dba646-1f12-41f5-b1c2-7216e9384a93 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 404 len: 111 microversion: 2.1 time: 0.030449 Aug 19 16:39:48.278140 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 550/1094] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:39:48 2022] DELETE /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:39:48.283490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-cc34170d-4950-4360-a9fe-e6991ccaaca7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:48.284319 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-cc34170d-4950-4360-a9fe-e6991ccaaca7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] [instance: 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:48.291056 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cc34170d-4950-4360-a9fe-e6991ccaaca7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:48.292146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cc34170d-4950-4360-a9fe-e6991ccaaca7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:48.292146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cc34170d-4950-4360-a9fe-e6991ccaaca7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:48.292889 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cc34170d-4950-4360-a9fe-e6991ccaaca7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:48.293429 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cc34170d-4950-4360-a9fe-e6991ccaaca7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:48.293945 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-cc34170d-4950-4360-a9fe-e6991ccaaca7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:48.308985 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-cc34170d-4950-4360-a9fe-e6991ccaaca7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] HTTP exception thrown: Instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 could not be found. Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-cc34170d-4950-4360-a9fe-e6991ccaaca7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Request method failure captured: Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 HTTP/1.1 Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7sAw9LcxO6N0pZY1nhZLJGTFHO5NOhvu1eVk6xTEodx-7uYGCVFosqHM2vYV2yCCDgERTbLEbTufj2duylmwK82XOJGkc69LfohAu5wx0GlI5NYAoHX6aVSGY0q6pl5_M_R0V-WnUvH1N5W6DXSAAPQV7ymDnRnchpgyuPHrFewp9k Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:39:48.310620 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:39:48.312190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1743538991c8415394ac6cd5aed28d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1743538991c8415394ac6cd5aed28d6a"}]}] Aug 19 16:39:48.312190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:48.312190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: 1743538991c8415394ac6cd5aed28d6a Aug 19 16:39:48.312190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-705823275 Aug 19 16:39:48.312190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:39:48.312190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:39:48.312190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:39:48.312190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: 9b0455ae3ec94c929c940df6a0f6687d Aug 19 16:39:48.312190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-AttachVolumeNegativeTest-705823275-project Aug 19 16:39:48.312190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:39:48.312190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 could not be found. Aug 19 16:39:48.312190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': '9f1f3d4e-7c83-4d2b-a34f-4cac4b871285'} Aug 19 16:39:48.313083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:39:48.313083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:48.313083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:39:48.313083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:39:48.313083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:39:48.313083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:39:48.313083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:39:48.313083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:39:48.313083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:39:48.313083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:39:48.313083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 could not be found. Aug 19 16:39:48.313083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:48.313083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:48.313083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:48.313083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:48.313083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:48.313083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:48.313083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:39:48.313083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:39:48.313083 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:39:48.314692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:39:48.314692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:39:48.314692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:39:48.314692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:39:48.314692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:39:48.314692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:39:48.314692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:39:48.314692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 could not be found. Aug 19 16:39:48.314692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:48.314692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:48.314692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:48.314692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:48.314692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:48.314692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:48.314692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:39:48.314692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:39:48.314692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 could not be found. Aug 19 16:39:48.314692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:48.315759 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-cc34170d-4950-4360-a9fe-e6991ccaaca7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] Returning 404 to user: Instance 9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:39:48.315759 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-cc34170d-4950-4360-a9fe-e6991ccaaca7 tempest-AttachVolumeNegativeTest-705823275 tempest-AttachVolumeNegativeTest-705823275-project] 10.222.0.55 "GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285" status: 404 len: 111 microversion: 2.1 time: 0.033934 Aug 19 16:39:48.315759 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 545/1095] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:39:48 2022] GET /compute/v2.1/servers/9f1f3d4e-7c83-4d2b-a34f-4cac4b871285 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:39:48.464701 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-4baf4b0b-c2d6-4a48-a806-9a8adb8223f5 req-d4eaea3b-dbb4-4edb-8910-f236ce236fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99fc027-bd6e-4ba2-9beb-d7277f387542", "name": "network-vif-deleted", "tag": "1e7ac66a-3d3d-4107-909c-ab6a1732405a"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:39:48.475523 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-4baf4b0b-c2d6-4a48-a806-9a8adb8223f5 req-d4eaea3b-dbb4-4edb-8910-f236ce236fb9 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:48.475994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-4baf4b0b-c2d6-4a48-a806-9a8adb8223f5 req-d4eaea3b-dbb4-4edb-8910-f236ce236fb9 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:48.476499 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-4baf4b0b-c2d6-4a48-a806-9a8adb8223f5 req-d4eaea3b-dbb4-4edb-8910-f236ce236fb9 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:48.488719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-4baf4b0b-c2d6-4a48-a806-9a8adb8223f5 req-d4eaea3b-dbb4-4edb-8910-f236ce236fb9 service nova] Creating event network-vif-deleted:1e7ac66a-3d3d-4107-909c-ab6a1732405a for instance d99fc027-bd6e-4ba2-9beb-d7277f387542 on hv-cinder-83124 Aug 19 16:39:48.493725 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-4baf4b0b-c2d6-4a48-a806-9a8adb8223f5 req-d4eaea3b-dbb4-4edb-8910-f236ce236fb9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033469 Aug 19 16:39:48.496919 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 551/1096] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:48.730691 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ace19abb-1370-4295-95a6-5aada900d6af tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:48.731306 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ace19abb-1370-4295-95a6-5aada900d6af tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:48.737458 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ace19abb-1370-4295-95a6-5aada900d6af tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:48.738717 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ace19abb-1370-4295-95a6-5aada900d6af tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:48.739386 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ace19abb-1370-4295-95a6-5aada900d6af tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:48.740320 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ace19abb-1370-4295-95a6-5aada900d6af tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:48.741264 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ace19abb-1370-4295-95a6-5aada900d6af tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:48.742018 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ace19abb-1370-4295-95a6-5aada900d6af tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:48.779353 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ace19abb-1370-4295-95a6-5aada900d6af tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:48.779838 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ace19abb-1370-4295-95a6-5aada900d6af tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:48.780514 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ace19abb-1370-4295-95a6-5aada900d6af tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:48.780996 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.objects.instance [None req-ace19abb-1370-4295-95a6-5aada900d6af tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lazy-loading 'fault' on Instance uuid d99fc027-bd6e-4ba2-9beb-d7277f387542 {{(pid=127285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:39:48.825496 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ace19abb-1370-4295-95a6-5aada900d6af tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55dc52ab80642da90f05e74092ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15ca27a2c874997bd01de973a948311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:48.834895 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ace19abb-1370-4295-95a6-5aada900d6af tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542" status: 200 len: 1327 microversion: 2.1 time: 0.108648 Aug 19 16:39:48.835697 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 546/1097] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:39:48 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:39:49.858721 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-0498c667-d211-4580-898c-3247378bd12b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:49.859342 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-0498c667-d211-4580-898c-3247378bd12b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:49.865513 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0498c667-d211-4580-898c-3247378bd12b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:49.865997 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0498c667-d211-4580-898c-3247378bd12b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:49.866438 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0498c667-d211-4580-898c-3247378bd12b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:49.867261 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0498c667-d211-4580-898c-3247378bd12b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:49.867614 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0498c667-d211-4580-898c-3247378bd12b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:49.868044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0498c667-d211-4580-898c-3247378bd12b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:49.881350 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-0498c667-d211-4580-898c-3247378bd12b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] HTTP exception thrown: Instance d99fc027-bd6e-4ba2-9beb-d7277f387542 could not be found. Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-0498c667-d211-4580-898c-3247378bd12b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Request method failure captured: Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 HTTP/1.1 Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7sEsq1PtiZN4apoXaUUVhZq5WWlx5ZN_L-k1CpYa9U8U0yJgQWrekR3pqZNU--GCFfzY1eONTPx_Og-ypg_M0J6cAF5i3MJBNciikCwmAhcw4dEdfvO2G4DFJ0nuxAQOpyqe6mznIEPIZ4yEqSSMRD_IBzNSlULA4ROXu-8Zy8w3uk Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: e15ca27a2c874997bd01de973a948311 Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-AttachVolumeTestJSON-1651088909 Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:39:49.883238 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:39:49.884587 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e15ca27a2c874997bd01de973a948311"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e15ca27a2c874997bd01de973a948311"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e15ca27a2c874997bd01de973a948311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e15ca27a2c874997bd01de973a948311"}]}] Aug 19 16:39:49.884587 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-AttachVolumeTestJSON-1651088909 Aug 19 16:39:49.884587 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: e15ca27a2c874997bd01de973a948311 Aug 19 16:39:49.884587 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1651088909 Aug 19 16:39:49.884587 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-AttachVolumeTestJSON-1651088909-project Aug 19 16:39:49.884587 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:39:49.884587 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:39:49.884587 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: d55dc52ab80642da90f05e74092ffdf8 Aug 19 16:39:49.884587 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-AttachVolumeTestJSON-1651088909-project Aug 19 16:39:49.884587 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:39:49.884587 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance d99fc027-bd6e-4ba2-9beb-d7277f387542 could not be found. Aug 19 16:39:49.884587 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': 'd99fc027-bd6e-4ba2-9beb-d7277f387542'} Aug 19 16:39:49.885362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:39:49.885362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:49.885362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:39:49.885362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:39:49.885362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:39:49.885362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:39:49.885362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:39:49.885362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:39:49.885362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:39:49.885362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:39:49.885362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d99fc027-bd6e-4ba2-9beb-d7277f387542 could not be found. Aug 19 16:39:49.885362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:49.885362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:49.885362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:49.885362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:49.885362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:49.885362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:49.885362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:39:49.885362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:39:49.885362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:39:49.886529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:39:49.886529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:39:49.886529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:39:49.886529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:39:49.886529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:39:49.886529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:39:49.886529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:39:49.886529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d99fc027-bd6e-4ba2-9beb-d7277f387542 could not be found. Aug 19 16:39:49.886529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:49.886529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:49.886529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:49.886529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:49.886529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:49.886529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:49.886529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:39:49.886529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:39:49.886529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d99fc027-bd6e-4ba2-9beb-d7277f387542 could not be found. Aug 19 16:39:49.886529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:49.887621 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-0498c667-d211-4580-898c-3247378bd12b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Returning 404 to user: Instance d99fc027-bd6e-4ba2-9beb-d7277f387542 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:39:49.887621 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-0498c667-d211-4580-898c-3247378bd12b tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542" status: 404 len: 111 microversion: 2.1 time: 0.030720 Aug 19 16:39:49.887621 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 552/1098] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:39:49 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:39:49.893444 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c5c99753-ca16-489d-a35d-ef74e713404e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '.version_select at 0x7fb01e092e50>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:49.912664 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c5c99753-ca16-489d-a35d-ef74e713404e tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1396876584" status: 202 len: 0 microversion: 2.1 time: 0.022958 Aug 19 16:39:49.913234 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 547/1099] 10.222.0.55 () {58 vars in 1221 bytes} [Fri Aug 19 16:39:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1396876584 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:39:52.936172 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-89858f86-05e1-45d1-9205-25c62c0d8582 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:52.936795 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-89858f86-05e1-45d1-9205-25c62c0d8582 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:52.942937 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-89858f86-05e1-45d1-9205-25c62c0d8582 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:52.943483 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-89858f86-05e1-45d1-9205-25c62c0d8582 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:52.943998 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-89858f86-05e1-45d1-9205-25c62c0d8582 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:52.944766 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-89858f86-05e1-45d1-9205-25c62c0d8582 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:52.945222 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-89858f86-05e1-45d1-9205-25c62c0d8582 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:52.945767 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-89858f86-05e1-45d1-9205-25c62c0d8582 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:52.959992 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-89858f86-05e1-45d1-9205-25c62c0d8582 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] HTTP exception thrown: Instance d99fc027-bd6e-4ba2-9beb-d7277f387542 could not be found. Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-89858f86-05e1-45d1-9205-25c62c0d8582 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Request method failure captured: Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: DELETE /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 HTTP/1.1 Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7sEsq1PtiZN4apoXaUUVhZq5WWlx5ZN_L-k1CpYa9U8U0yJgQWrekR3pqZNU--GCFfzY1eONTPx_Og-ypg_M0J6cAF5i3MJBNciikCwmAhcw4dEdfvO2G4DFJ0nuxAQOpyqe6mznIEPIZ4yEqSSMRD_IBzNSlULA4ROXu-8Zy8w3uk Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: e15ca27a2c874997bd01de973a948311 Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-AttachVolumeTestJSON-1651088909 Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:39:52.962151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:39:52.963444 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e15ca27a2c874997bd01de973a948311"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e15ca27a2c874997bd01de973a948311"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e15ca27a2c874997bd01de973a948311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e15ca27a2c874997bd01de973a948311"}]}] Aug 19 16:39:52.963444 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-AttachVolumeTestJSON-1651088909 Aug 19 16:39:52.963444 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: e15ca27a2c874997bd01de973a948311 Aug 19 16:39:52.963444 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1651088909 Aug 19 16:39:52.963444 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-AttachVolumeTestJSON-1651088909-project Aug 19 16:39:52.963444 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:39:52.963444 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:39:52.963444 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: d55dc52ab80642da90f05e74092ffdf8 Aug 19 16:39:52.963444 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-AttachVolumeTestJSON-1651088909-project Aug 19 16:39:52.963444 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:39:52.963444 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance d99fc027-bd6e-4ba2-9beb-d7277f387542 could not be found. Aug 19 16:39:52.963444 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': 'd99fc027-bd6e-4ba2-9beb-d7277f387542'} Aug 19 16:39:52.964177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:39:52.964177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:52.964177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:39:52.964177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:39:52.964177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:39:52.964177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:39:52.964177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:39:52.964177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:39:52.964177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:39:52.964177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:39:52.964177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d99fc027-bd6e-4ba2-9beb-d7277f387542 could not be found. Aug 19 16:39:52.964177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:52.964177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:52.964177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:52.964177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:52.964177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:52.964177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:52.964177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:39:52.964177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:39:52.964177 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:39:52.965366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:39:52.965366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 16:39:52.965366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 16:39:52.965366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 16:39:52.965366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 16:39:52.965366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:39:52.965366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:39:52.965366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:39:52.965366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:39:52.965366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d99fc027-bd6e-4ba2-9beb-d7277f387542 could not be found. Aug 19 16:39:52.965366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:52.965366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:52.965366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:52.965366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:52.965366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:52.965366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:52.965366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:39:52.965366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:39:52.965366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d99fc027-bd6e-4ba2-9beb-d7277f387542 could not be found. Aug 19 16:39:52.965366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:52.966549 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-89858f86-05e1-45d1-9205-25c62c0d8582 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Returning 404 to user: Instance d99fc027-bd6e-4ba2-9beb-d7277f387542 could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:39:52.966549 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-89858f86-05e1-45d1-9205-25c62c0d8582 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542" status: 404 len: 111 microversion: 2.1 time: 0.031744 Aug 19 16:39:52.966549 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 548/1100] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:39:52 2022] DELETE /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 16:39:52.972153 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4dd474e7-de39-4e86-a839-c0cb19aca159 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:52.972854 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-4dd474e7-de39-4e86-a839-c0cb19aca159 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: d99fc027-bd6e-4ba2-9beb-d7277f387542] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:52.979190 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4dd474e7-de39-4e86-a839-c0cb19aca159 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:52.979745 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4dd474e7-de39-4e86-a839-c0cb19aca159 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:52.980246 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4dd474e7-de39-4e86-a839-c0cb19aca159 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:52.981036 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4dd474e7-de39-4e86-a839-c0cb19aca159 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:52.981553 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4dd474e7-de39-4e86-a839-c0cb19aca159 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:52.982046 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4dd474e7-de39-4e86-a839-c0cb19aca159 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:52.995589 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-4dd474e7-de39-4e86-a839-c0cb19aca159 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] HTTP exception thrown: Instance d99fc027-bd6e-4ba2-9beb-d7277f387542 could not be found. Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4dd474e7-de39-4e86-a839-c0cb19aca159 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Request method failure captured: Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 HTTP/1.1 Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7sEsq1PtiZN4apoXaUUVhZq5WWlx5ZN_L-k1CpYa9U8U0yJgQWrekR3pqZNU--GCFfzY1eONTPx_Og-ypg_M0J6cAF5i3MJBNciikCwmAhcw4dEdfvO2G4DFJ0nuxAQOpyqe6mznIEPIZ4yEqSSMRD_IBzNSlULA4ROXu-8Zy8w3uk Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: e15ca27a2c874997bd01de973a948311 Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-AttachVolumeTestJSON-1651088909 Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:39:52.997134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:39:52.998724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e15ca27a2c874997bd01de973a948311"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e15ca27a2c874997bd01de973a948311"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e15ca27a2c874997bd01de973a948311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e15ca27a2c874997bd01de973a948311"}]}] Aug 19 16:39:52.998724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-AttachVolumeTestJSON-1651088909 Aug 19 16:39:52.998724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: e15ca27a2c874997bd01de973a948311 Aug 19 16:39:52.998724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1651088909 Aug 19 16:39:52.998724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-AttachVolumeTestJSON-1651088909-project Aug 19 16:39:52.998724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:39:52.998724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:39:52.998724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: d55dc52ab80642da90f05e74092ffdf8 Aug 19 16:39:52.998724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-AttachVolumeTestJSON-1651088909-project Aug 19 16:39:52.998724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:39:52.998724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance d99fc027-bd6e-4ba2-9beb-d7277f387542 could not be found. Aug 19 16:39:52.998724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': 'd99fc027-bd6e-4ba2-9beb-d7277f387542'} Aug 19 16:39:52.999656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:39:52.999656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:52.999656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:39:52.999656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:39:52.999656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:39:52.999656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:39:52.999656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:39:52.999656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:39:52.999656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:39:52.999656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:39:52.999656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d99fc027-bd6e-4ba2-9beb-d7277f387542 could not be found. Aug 19 16:39:52.999656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:52.999656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:52.999656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:52.999656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:52.999656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:52.999656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:52.999656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:39:52.999656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:39:52.999656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:39:53.001064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:39:53.001064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:39:53.001064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:39:53.001064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:39:53.001064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:39:53.001064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:39:53.001064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:39:53.001064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d99fc027-bd6e-4ba2-9beb-d7277f387542 could not be found. Aug 19 16:39:53.001064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:53.001064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:53.001064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:53.001064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:53.001064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:53.001064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:53.001064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:39:53.001064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:39:53.001064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d99fc027-bd6e-4ba2-9beb-d7277f387542 could not be found. Aug 19 16:39:53.001064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:53.002701 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4dd474e7-de39-4e86-a839-c0cb19aca159 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Returning 404 to user: Instance d99fc027-bd6e-4ba2-9beb-d7277f387542 could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:39:53.002701 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4dd474e7-de39-4e86-a839-c0cb19aca159 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542" status: 404 len: 111 microversion: 2.1 time: 0.030033 Aug 19 16:39:53.002701 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 549/1101] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:39:52 2022] GET /compute/v2.1/servers/d99fc027-bd6e-4ba2-9beb-d7277f387542 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:39:53.074485 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-9e20d56c-808f-483b-9d1a-7f48b43960a5 tempest-VolumesGetTestJSON-1475857918 tempest-VolumesGetTestJSON-1475857918-project] Action: 'create', calling method: .version_select at 0x7fb01e128af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1288649996", "metadata": {"Type": "work"}}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:39:53.366126 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-9e20d56c-808f-483b-9d1a-7f48b43960a5 tempest-VolumesGetTestJSON-1475857918 tempest-VolumesGetTestJSON-1475857918-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.451988 Aug 19 16:39:53.366743 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 553/1102] 10.222.0.55 () {60 vars in 1156 bytes} [Fri Aug 19 16:39:52 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 453 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 19 16:39:53.379833 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-53fe16ea-6155-4f79-b52e-763ce1b8768f tempest-VolumesGetTestJSON-1475857918 tempest-VolumesGetTestJSON-1475857918-project] Calling method '.version_select at 0x7fb01e152e50>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:53.434702 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-53fe16ea-6155-4f79-b52e-763ce1b8768f tempest-VolumesGetTestJSON-1475857918 tempest-VolumesGetTestJSON-1475857918-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/4f3f96f2-0515-4737-b162-81264a41ae71" status: 200 len: 353 microversion: 2.1 time: 0.058602 Aug 19 16:39:53.435341 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 550/1103] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Aug 19 16:39:53 2022] GET /compute/v2.1/os-volumes/4f3f96f2-0515-4737-b162-81264a41ae71 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:54.142072 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-71fd64e1-7474-4a81-a7df-199edba5f529 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:54.142770 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-71fd64e1-7474-4a81-a7df-199edba5f529 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:54.150858 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-71fd64e1-7474-4a81-a7df-199edba5f529 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:54.151471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-71fd64e1-7474-4a81-a7df-199edba5f529 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:54.152037 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-71fd64e1-7474-4a81-a7df-199edba5f529 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:54.153008 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-71fd64e1-7474-4a81-a7df-199edba5f529 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:54.153531 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-71fd64e1-7474-4a81-a7df-199edba5f529 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:54.154247 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-71fd64e1-7474-4a81-a7df-199edba5f529 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:54.170362 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-71fd64e1-7474-4a81-a7df-199edba5f529 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] HTTP exception thrown: Instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 could not be found. Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-71fd64e1-7474-4a81-a7df-199edba5f529 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Request method failure captured: Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: DELETE /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 HTTP/1.1 Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7sEsq1PtiZN4apoXaUUVhZq5WWlx5ZN_L-k1CpYa9U8U0yJgQWrekR3pqZNU--GCFfzY1eONTPx_Og-ypg_M0J6cAF5i3MJBNciikCwmAhcw4dEdfvO2G4DFJ0nuxAQOpyqe6mznIEPIZ4yEqSSMRD_IBzNSlULA4ROXu-8Zy8w3uk Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: e15ca27a2c874997bd01de973a948311 Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-AttachVolumeTestJSON-1651088909 Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:39:54.171937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:39:54.173569 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e15ca27a2c874997bd01de973a948311"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e15ca27a2c874997bd01de973a948311"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e15ca27a2c874997bd01de973a948311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e15ca27a2c874997bd01de973a948311"}]}] Aug 19 16:39:54.173569 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-AttachVolumeTestJSON-1651088909 Aug 19 16:39:54.173569 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: e15ca27a2c874997bd01de973a948311 Aug 19 16:39:54.173569 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1651088909 Aug 19 16:39:54.173569 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-AttachVolumeTestJSON-1651088909-project Aug 19 16:39:54.173569 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:39:54.173569 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:39:54.173569 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: d55dc52ab80642da90f05e74092ffdf8 Aug 19 16:39:54.173569 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-AttachVolumeTestJSON-1651088909-project Aug 19 16:39:54.173569 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:39:54.173569 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 could not be found. Aug 19 16:39:54.173569 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': 'a1eddf01-3fc7-4c5c-8560-96cddb34a199'} Aug 19 16:39:54.177468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:39:54.177468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:54.177468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:39:54.177468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:39:54.177468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:39:54.177468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:39:54.177468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:39:54.177468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:39:54.177468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:39:54.177468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:39:54.177468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 could not be found. Aug 19 16:39:54.177468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:54.177468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:54.177468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:54.177468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:54.177468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:54.177468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:54.177468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:39:54.177468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:39:54.177468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:39:54.178892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:39:54.178892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 16:39:54.178892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 16:39:54.178892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 16:39:54.178892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 16:39:54.178892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:39:54.178892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:39:54.178892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:39:54.178892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:39:54.178892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 could not be found. Aug 19 16:39:54.178892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:54.178892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:54.178892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:54.178892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:54.178892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:54.178892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:54.178892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:39:54.178892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:39:54.178892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 could not be found. Aug 19 16:39:54.178892 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:54.180678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-71fd64e1-7474-4a81-a7df-199edba5f529 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Returning 404 to user: Instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:39:54.180678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-71fd64e1-7474-4a81-a7df-199edba5f529 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 404 len: 111 microversion: 2.1 time: 0.035761 Aug 19 16:39:54.180678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 554/1104] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:39:54 2022] DELETE /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:39:54.186880 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-37b12929-3598-4e03-bc69-53d01fa16fe0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:54.187571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-37b12929-3598-4e03-bc69-53d01fa16fe0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] [instance: a1eddf01-3fc7-4c5c-8560-96cddb34a199] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:54.188026 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-78054191-c298-4f7c-afc7-3facaaeba3f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:54.190715 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-78054191-c298-4f7c-afc7-3facaaeba3f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:54.195409 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-37b12929-3598-4e03-bc69-53d01fa16fe0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:54.195942 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-37b12929-3598-4e03-bc69-53d01fa16fe0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:54.196615 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-37b12929-3598-4e03-bc69-53d01fa16fe0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:54.196988 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-78054191-c298-4f7c-afc7-3facaaeba3f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:54.197305 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-78054191-c298-4f7c-afc7-3facaaeba3f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:54.197475 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-37b12929-3598-4e03-bc69-53d01fa16fe0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:54.197717 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-78054191-c298-4f7c-afc7-3facaaeba3f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:54.197957 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-37b12929-3598-4e03-bc69-53d01fa16fe0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:54.198408 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-78054191-c298-4f7c-afc7-3facaaeba3f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:54.198601 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-37b12929-3598-4e03-bc69-53d01fa16fe0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:54.198987 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-78054191-c298-4f7c-afc7-3facaaeba3f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:54.199358 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-78054191-c298-4f7c-afc7-3facaaeba3f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:54.214932 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-37b12929-3598-4e03-bc69-53d01fa16fe0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] HTTP exception thrown: Instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 could not be found. Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-37b12929-3598-4e03-bc69-53d01fa16fe0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Request method failure captured: Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 HTTP/1.1 Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7sEsq1PtiZN4apoXaUUVhZq5WWlx5ZN_L-k1CpYa9U8U0yJgQWrekR3pqZNU--GCFfzY1eONTPx_Og-ypg_M0J6cAF5i3MJBNciikCwmAhcw4dEdfvO2G4DFJ0nuxAQOpyqe6mznIEPIZ4yEqSSMRD_IBzNSlULA4ROXu-8Zy8w3uk Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: e15ca27a2c874997bd01de973a948311 Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-AttachVolumeTestJSON-1651088909 Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:39:54.216688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:39:54.218151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e15ca27a2c874997bd01de973a948311"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e15ca27a2c874997bd01de973a948311"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e15ca27a2c874997bd01de973a948311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e15ca27a2c874997bd01de973a948311"}]}] Aug 19 16:39:54.218151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-AttachVolumeTestJSON-1651088909 Aug 19 16:39:54.218151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: e15ca27a2c874997bd01de973a948311 Aug 19 16:39:54.218151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1651088909 Aug 19 16:39:54.218151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-AttachVolumeTestJSON-1651088909-project Aug 19 16:39:54.218151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:39:54.218151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:39:54.218151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: d55dc52ab80642da90f05e74092ffdf8 Aug 19 16:39:54.218151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-AttachVolumeTestJSON-1651088909-project Aug 19 16:39:54.218151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:39:54.218151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 could not be found. Aug 19 16:39:54.218151 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': 'a1eddf01-3fc7-4c5c-8560-96cddb34a199'} Aug 19 16:39:54.219010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:39:54.219010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:54.219010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:39:54.219010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:39:54.219010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:39:54.219010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:39:54.219010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:39:54.219010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:39:54.219010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:39:54.219010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:39:54.219010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 could not be found. Aug 19 16:39:54.219010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:54.219010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:54.219010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:54.219010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:54.219010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:54.219010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:54.219010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:39:54.219010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:39:54.219010 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:39:54.220162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:39:54.220162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:39:54.220162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:39:54.220162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:39:54.220162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:39:54.220162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:39:54.220162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:39:54.220162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 could not be found. Aug 19 16:39:54.220162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:54.220162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:54.220162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:54.220162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:54.220162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:54.220162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:54.220162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:39:54.220162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:39:54.220162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 could not be found. Aug 19 16:39:54.220162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:39:54.221238 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-37b12929-3598-4e03-bc69-53d01fa16fe0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] Returning 404 to user: Instance a1eddf01-3fc7-4c5c-8560-96cddb34a199 could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:39:54.221238 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-37b12929-3598-4e03-bc69-53d01fa16fe0 tempest-AttachVolumeTestJSON-1651088909 tempest-AttachVolumeTestJSON-1651088909-project] 10.222.0.55 "GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199" status: 404 len: 111 microversion: 2.1 time: 0.039388 Aug 19 16:39:54.221238 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 551/1105] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:39:54 2022] GET /compute/v2.1/servers/a1eddf01-3fc7-4c5c-8560-96cddb34a199 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:39:54.231758 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:39:54.239030 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-78054191-c298-4f7c-afc7-3facaaeba3f9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054768 Aug 19 16:39:54.239603 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 555/1106] 10.222.0.55 () {60 vars in 1343 bytes} [Fri Aug 19 16:39:54 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:39:54.307130 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-90cf38e6-3249-4663-9a1e-aa94cc7bd94f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:54.307699 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-90cf38e6-3249-4663-9a1e-aa94cc7bd94f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:54.314430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-90cf38e6-3249-4663-9a1e-aa94cc7bd94f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:54.314976 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-90cf38e6-3249-4663-9a1e-aa94cc7bd94f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:54.315478 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-90cf38e6-3249-4663-9a1e-aa94cc7bd94f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:54.316237 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-90cf38e6-3249-4663-9a1e-aa94cc7bd94f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:54.316775 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-90cf38e6-3249-4663-9a1e-aa94cc7bd94f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:54.317293 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-90cf38e6-3249-4663-9a1e-aa94cc7bd94f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:54.344214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-90cf38e6-3249-4663-9a1e-aa94cc7bd94f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Going to try to terminate instance {{(pid=127285) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:39:54.433576 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-90cf38e6-3249-4663-9a1e-aa94cc7bd94f tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 204 len: 0 microversion: 2.20 time: 0.130066 Aug 19 16:39:54.434168 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 552/1107] 10.222.0.55 () {60 vars in 1280 bytes} [Fri Aug 19 16:39:54 2022] DELETE /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 19 16:39:54.443160 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-a09c2e81-f41c-4839-8c2b-1350a90846d8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:54.443774 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-a09c2e81-f41c-4839-8c2b-1350a90846d8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:54.454449 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a09c2e81-f41c-4839-8c2b-1350a90846d8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:54.454678 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-935322a1-4775-42f8-9f43-9fc8fc5b59e1 tempest-VolumesGetTestJSON-1475857918 tempest-VolumesGetTestJSON-1475857918-project] Calling method '.version_select at 0x7fb01e525ca0>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:54.455271 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a09c2e81-f41c-4839-8c2b-1350a90846d8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:54.455999 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a09c2e81-f41c-4839-8c2b-1350a90846d8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:54.457480 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a09c2e81-f41c-4839-8c2b-1350a90846d8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:54.458263 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a09c2e81-f41c-4839-8c2b-1350a90846d8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:54.458986 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-a09c2e81-f41c-4839-8c2b-1350a90846d8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:54.538491 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-935322a1-4775-42f8-9f43-9fc8fc5b59e1 tempest-VolumesGetTestJSON-1475857918 tempest-VolumesGetTestJSON-1475857918-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/4f3f96f2-0515-4737-b162-81264a41ae71" status: 200 len: 354 microversion: 2.1 time: 0.093971 Aug 19 16:39:54.539597 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 553/1108] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Aug 19 16:39:54 2022] GET /compute/v2.1/os-volumes/4f3f96f2-0515-4737-b162-81264a41ae71 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:39:54.552071 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f4075871-3be9-41af-aa25-28c800473319 tempest-VolumesGetTestJSON-1475857918 tempest-VolumesGetTestJSON-1475857918-project] Calling method '.version_select at 0x7fb01e043280>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:54.606006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f4075871-3be9-41af-aa25-28c800473319 tempest-VolumesGetTestJSON-1475857918 tempest-VolumesGetTestJSON-1475857918-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/4f3f96f2-0515-4737-b162-81264a41ae71" status: 200 len: 354 microversion: 2.1 time: 0.057766 Aug 19 16:39:54.606566 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 554/1109] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Aug 19 16:39:54 2022] GET /compute/v2.1/os-volumes/4f3f96f2-0515-4737-b162-81264a41ae71 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:39:54.616145 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a09c2e81-f41c-4839-8c2b-1350a90846d8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:54.620200 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a09c2e81-f41c-4839-8c2b-1350a90846d8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:54.622482 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-a09c2e81-f41c-4839-8c2b-1350a90846d8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:54.624342 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-a09c2e81-f41c-4839-8c2b-1350a90846d8 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1720 microversion: 2.20 time: 0.185327 Aug 19 16:39:54.624724 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3801b600-3c0e-47d9-8c9d-d086871e2733 tempest-VolumesGetTestJSON-1475857918 tempest-VolumesGetTestJSON-1475857918-project] Calling method '.version_select at 0x7fb0228d2310>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:54.628802 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 556/1110] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:54 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 16:39:54.693311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3801b600-3c0e-47d9-8c9d-d086871e2733 tempest-VolumesGetTestJSON-1475857918 tempest-VolumesGetTestJSON-1475857918-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/4f3f96f2-0515-4737-b162-81264a41ae71" status: 202 len: 0 microversion: 2.1 time: 0.072206 Aug 19 16:39:54.693959 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 555/1111] 10.222.0.55 () {58 vars in 1248 bytes} [Fri Aug 19 16:39:54 2022] DELETE /compute/v2.1/os-volumes/4f3f96f2-0515-4737-b162-81264a41ae71 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 19 16:39:54.702698 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-cc36507c-0f5d-42be-836b-285a4349ed54 tempest-VolumesGetTestJSON-1475857918 tempest-VolumesGetTestJSON-1475857918-project] Calling method '.version_select at 0x7fb01e353e50>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:54.750917 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-cc36507c-0f5d-42be-836b-285a4349ed54 tempest-VolumesGetTestJSON-1475857918 tempest-VolumesGetTestJSON-1475857918-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/4f3f96f2-0515-4737-b162-81264a41ae71" status: 200 len: 353 microversion: 2.1 time: 0.051986 Aug 19 16:39:54.751483 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 557/1112] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Aug 19 16:39:54 2022] GET /compute/v2.1/os-volumes/4f3f96f2-0515-4737-b162-81264a41ae71 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:39:55.648150 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-824780a7-e386-45da-a342-89ae167c8668 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:55.650006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-824780a7-e386-45da-a342-89ae167c8668 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:55.656406 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-824780a7-e386-45da-a342-89ae167c8668 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:55.656842 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-824780a7-e386-45da-a342-89ae167c8668 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:55.657280 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-824780a7-e386-45da-a342-89ae167c8668 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:55.658035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-824780a7-e386-45da-a342-89ae167c8668 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:55.658411 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-824780a7-e386-45da-a342-89ae167c8668 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:55.658937 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-824780a7-e386-45da-a342-89ae167c8668 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:55.766598 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-badab933-ccd6-4fa4-bf31-369f5adc3722 tempest-VolumesGetTestJSON-1475857918 tempest-VolumesGetTestJSON-1475857918-project] Calling method '.version_select at 0x7fb01e450670>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:55.796331 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-badab933-ccd6-4fa4-bf31-369f5adc3722 tempest-VolumesGetTestJSON-1475857918 tempest-VolumesGetTestJSON-1475857918-project] HTTP exception thrown: Volume 4f3f96f2-0515-4737-b162-81264a41ae71 could not be found. Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-badab933-ccd6-4fa4-bf31-369f5adc3722 tempest-VolumesGetTestJSON-1475857918 tempest-VolumesGetTestJSON-1475857918-project] Request method failure captured: Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: GET /compute/v2.1/os-volumes/4f3f96f2-0515-4737-b162-81264a41ae71 HTTP/1.1 Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7zYo9jifaYYXTNWsVxVAzD8fUimocpzc-wMWTHXu3q6UD74qdg9j-JPIIuPcBJ5s4_fHXdFnulrRrcfMusJw5paxDTd6tDGuC9Ttqackg9V1zFa8SUuBYliK859yZpBFDrAz7axxn_QCLuqHHjMND4N0VXq_oFp5Eiy5SvsNNIqQK4 Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: 25c65e9c4d3d4e0f83d3996adfa9e9ea Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-VolumesGetTestJSON-1475857918 Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:39:55.799691 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:39:55.801288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_25c65e9c4d3d4e0f83d3996adfa9e9ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/25c65e9c4d3d4e0f83d3996adfa9e9ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/25c65e9c4d3d4e0f83d3996adfa9e9ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/25c65e9c4d3d4e0f83d3996adfa9e9ea"}]}] Aug 19 16:39:55.801288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-VolumesGetTestJSON-1475857918 Aug 19 16:39:55.801288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: 25c65e9c4d3d4e0f83d3996adfa9e9ea Aug 19 16:39:55.801288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-VolumesGetTestJSON-1475857918 Aug 19 16:39:55.801288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-VolumesGetTestJSON-1475857918-project Aug 19 16:39:55.801288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:39:55.801288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:39:55.801288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: 78b5db5d32e0479c98f77b8119a02eb5 Aug 19 16:39:55.801288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-VolumesGetTestJSON-1475857918-project Aug 19 16:39:55.801288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: Aug 19 16:39:55.801288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Volume 4f3f96f2-0515-4737-b162-81264a41ae71 could not be found. Aug 19 16:39:55.801288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': '4f3f96f2-0515-4737-b162-81264a41ae71'} Aug 19 16:39:55.801288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:39:55.802287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:55.802287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 16:39:55.802287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 16:39:55.802287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 16:39:55.802287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 16:39:55.802287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 16:39:55.802287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 16:39:55.802287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 16:39:55.802287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 16:39:55.802287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 16:39:55.802287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 16:39:55.802287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 16:39:55.802287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 16:39:55.802287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 16:39:55.802287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 16:39:55.802287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f3f96f2-0515-4737-b162-81264a41ae71 could not be found. (HTTP 404) (Request-ID: req-e8932332-d963-407e-aac4-147abd25e761) Aug 19 16:39:55.802287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:55.802287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:55.802287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:55.803690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:55.803690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 19 16:39:55.803690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 19 16:39:55.803690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 16:39:55.803690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 16:39:55.803690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 16:39:55.803690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 16:39:55.803690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 16:39:55.803690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 16:39:55.803690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 16:39:55.803690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 16:39:55.803690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 16:39:55.803690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 16:39:55.803690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 16:39:55.803690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 16:39:55.803690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 16:39:55.803690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 16:39:55.803690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 16:39:55.803690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 16:39:55.805994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 16:39:55.805994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 16:39:55.805994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 16:39:55.805994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 16:39:55.805994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f3f96f2-0515-4737-b162-81264a41ae71 could not be found. Aug 19 16:39:55.805994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:55.805994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:55.805994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:55.805994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:55.805994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:55.805994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:55.805994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:39:55.805994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:39:55.805994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 16:39:55.805994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 16:39:55.805994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:39:55.805994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:39:55.805994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 19 16:39:55.805994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:39:55.808467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f3f96f2-0515-4737-b162-81264a41ae71 could not be found. Aug 19 16:39:55.808467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:55.808467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:55.808467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:55.808467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:55.808467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:55.808467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:55.808467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:39:55.808467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:39:55.808467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f3f96f2-0515-4737-b162-81264a41ae71 could not be found. Aug 19 16:39:55.808467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:55.808467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-badab933-ccd6-4fa4-bf31-369f5adc3722 tempest-VolumesGetTestJSON-1475857918 tempest-VolumesGetTestJSON-1475857918-project] Returning 404 to user: Volume 4f3f96f2-0515-4737-b162-81264a41ae71 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:39:55.808467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-badab933-ccd6-4fa4-bf31-369f5adc3722 tempest-VolumesGetTestJSON-1475857918 tempest-VolumesGetTestJSON-1475857918-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/4f3f96f2-0515-4737-b162-81264a41ae71" status: 404 len: 109 microversion: 2.1 time: 0.039334 Aug 19 16:39:55.808467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 558/1113] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Aug 19 16:39:55 2022] GET /compute/v2.1/os-volumes/4f3f96f2-0515-4737-b162-81264a41ae71 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 16:39:56.063251 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-824780a7-e386-45da-a342-89ae167c8668 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:56.074356 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-824780a7-e386-45da-a342-89ae167c8668 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:56.076736 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-824780a7-e386-45da-a342-89ae167c8668 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:56.078014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-824780a7-e386-45da-a342-89ae167c8668 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1720 microversion: 2.20 time: 0.434416 Aug 19 16:39:56.078809 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 556/1114] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:55 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1720 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:39:57.103551 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ab9f5c59-0d13-42d6-895e-304dad72d896 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:57.104856 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ab9f5c59-0d13-42d6-895e-304dad72d896 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:57.111407 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ab9f5c59-0d13-42d6-895e-304dad72d896 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:57.114588 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ab9f5c59-0d13-42d6-895e-304dad72d896 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:57.114588 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ab9f5c59-0d13-42d6-895e-304dad72d896 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:57.114588 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ab9f5c59-0d13-42d6-895e-304dad72d896 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:57.114588 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ab9f5c59-0d13-42d6-895e-304dad72d896 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:57.115098 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ab9f5c59-0d13-42d6-895e-304dad72d896 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:57.281179 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ab9f5c59-0d13-42d6-895e-304dad72d896 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:57.296906 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ab9f5c59-0d13-42d6-895e-304dad72d896 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:57.305750 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ab9f5c59-0d13-42d6-895e-304dad72d896 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e09fd34737af41dc972d806dc3b0705e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d9f4004394e1cbcd0a2afffd114b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:39:57.308431 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ab9f5c59-0d13-42d6-895e-304dad72d896 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 200 len: 1720 microversion: 2.20 time: 0.207647 Aug 19 16:39:57.327724 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 559/1115] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:57 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 1720 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 16:39:57.834711 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-479e2aca-3f3f-4699-b550-a37c759f06a4 req-f9a117f6-eaa6-4785-beb4-c1114a3d559a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf04a2f-684c-4e14-8def-16324168613c", "name": "network-vif-deleted", "tag": "6f7012e8-b52a-4e31-8e3e-9304cba097fe"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:39:57.850785 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-479e2aca-3f3f-4699-b550-a37c759f06a4 req-f9a117f6-eaa6-4785-beb4-c1114a3d559a service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:57.851347 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-479e2aca-3f3f-4699-b550-a37c759f06a4 req-f9a117f6-eaa6-4785-beb4-c1114a3d559a service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:57.864474 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-479e2aca-3f3f-4699-b550-a37c759f06a4 req-f9a117f6-eaa6-4785-beb4-c1114a3d559a service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:57.892454 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-479e2aca-3f3f-4699-b550-a37c759f06a4 req-f9a117f6-eaa6-4785-beb4-c1114a3d559a service nova] Creating event network-vif-deleted:6f7012e8-b52a-4e31-8e3e-9304cba097fe for instance 5cf04a2f-684c-4e14-8def-16324168613c on hv-cinder-83124 Aug 19 16:39:57.908729 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-479e2aca-3f3f-4699-b550-a37c759f06a4 req-f9a117f6-eaa6-4785-beb4-c1114a3d559a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081433 Aug 19 16:39:57.910347 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 557/1116] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:39:58.337893 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d51e1040-0c81-4b4f-a8aa-42849e6da518 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:58.339036 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d51e1040-0c81-4b4f-a8aa-42849e6da518 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:39:58.346056 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d51e1040-0c81-4b4f-a8aa-42849e6da518 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:58.346807 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d51e1040-0c81-4b4f-a8aa-42849e6da518 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:58.347381 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d51e1040-0c81-4b4f-a8aa-42849e6da518 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:58.348620 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d51e1040-0c81-4b4f-a8aa-42849e6da518 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:39:58.349279 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d51e1040-0c81-4b4f-a8aa-42849e6da518 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:39:58.349919 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d51e1040-0c81-4b4f-a8aa-42849e6da518 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:39:58.367865 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-d51e1040-0c81-4b4f-a8aa-42849e6da518 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] HTTP exception thrown: Instance 5cf04a2f-684c-4e14-8def-16324168613c could not be found. Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d51e1040-0c81-4b4f-a8aa-42849e6da518 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Request method failure captured: Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c HTTP/1.1 Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7r8NPl9KLlLkhNOGInBRGRNd-I7oolYq-P7IATSskhixtxu9EuUSf9nALIq-WkwIyfVerYHUqQFfbM_4c8xWVZPqZ_QNvnuBw-qm8U_m0kNAcDMFsrQ2oiGjkKKHMURK4U6nm8BQS0aKQ7J_tJNyAyWOVpWRnH7JpAQKrYmW8Sanx8 Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Openstack-Nova-Api-Version: 2.20 Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: d22d9f4004394e1cbcd0a2afffd114b1 Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-46890877 Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:39:58.370289 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:39:58.371702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d22d9f4004394e1cbcd0a2afffd114b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d22d9f4004394e1cbcd0a2afffd114b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d22d9f4004394e1cbcd0a2afffd114b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d22d9f4004394e1cbcd0a2afffd114b1"}]}] Aug 19 16:39:58.371702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-AttachVolumeShelveTestJSON-46890877 Aug 19 16:39:58.371702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: d22d9f4004394e1cbcd0a2afffd114b1 Aug 19 16:39:58.371702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-46890877 Aug 19 16:39:58.371702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-AttachVolumeShelveTestJSON-46890877-project Aug 19 16:39:58.371702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:39:58.371702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:39:58.371702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: e09fd34737af41dc972d806dc3b0705e Aug 19 16:39:58.371702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-AttachVolumeShelveTestJSON-46890877-project Aug 19 16:39:58.371702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:39:58.371702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance 5cf04a2f-684c-4e14-8def-16324168613c could not be found. Aug 19 16:39:58.371702 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': '5cf04a2f-684c-4e14-8def-16324168613c'} Aug 19 16:39:58.372965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:39:58.372965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:58.372965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:39:58.372965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:39:58.372965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:39:58.372965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:39:58.372965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:39:58.372965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:39:58.372965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:39:58.372965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:39:58.372965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf04a2f-684c-4e14-8def-16324168613c could not be found. Aug 19 16:39:58.372965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:58.372965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:58.372965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:58.372965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:58.372965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:58.372965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:58.372965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:39:58.372965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:39:58.372965 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:39:58.374155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:39:58.374155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:39:58.374155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:39:58.374155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:39:58.374155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:39:58.374155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:39:58.374155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:39:58.374155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf04a2f-684c-4e14-8def-16324168613c could not be found. Aug 19 16:39:58.374155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:58.374155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:39:58.374155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:58.374155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:39:58.374155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:39:58.374155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:39:58.374155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:39:58.374155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:39:58.374155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf04a2f-684c-4e14-8def-16324168613c could not be found. Aug 19 16:39:58.374155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:39:58.376469 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d51e1040-0c81-4b4f-a8aa-42849e6da518 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Returning 404 to user: Instance 5cf04a2f-684c-4e14-8def-16324168613c could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:39:58.377798 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d51e1040-0c81-4b4f-a8aa-42849e6da518 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 404 len: 111 microversion: 2.20 time: 0.044998 Aug 19 16:39:58.382623 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 560/1117] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:39:58 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 19 16:39:58.388069 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4e99ffeb-539d-473b-8ca1-41617f11c6b2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '.version_select at 0x7fb0228d2ee0>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:39:58.415419 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4e99ffeb-539d-473b-8ca1-41617f11c6b2 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-369081726" status: 204 len: 0 microversion: 2.20 time: 0.031497 Aug 19 16:39:58.416179 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 558/1118] 10.222.0.55 () {60 vars in 1259 bytes} [Fri Aug 19 16:39:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-369081726 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 19 16:40:00.358893 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-38787f25-96ac-4964-9976-60425977008c tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Action: 'create', calling method: .version_select at 0x7fb01e30fdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-22361373"}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:40:00.501167 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1d71f1d9-9b68-4750-a624-7692183f4700 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:00.501883 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-1d71f1d9-9b68-4750-a624-7692183f4700 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:00.511615 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1d71f1d9-9b68-4750-a624-7692183f4700 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:00.512101 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1d71f1d9-9b68-4750-a624-7692183f4700 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:00.512630 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1d71f1d9-9b68-4750-a624-7692183f4700 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:00.513863 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1d71f1d9-9b68-4750-a624-7692183f4700 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:00.514823 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1d71f1d9-9b68-4750-a624-7692183f4700 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:00.515394 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1d71f1d9-9b68-4750-a624-7692183f4700 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:00.535050 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-1d71f1d9-9b68-4750-a624-7692183f4700 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] HTTP exception thrown: Instance 5cf04a2f-684c-4e14-8def-16324168613c could not be found. Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1d71f1d9-9b68-4750-a624-7692183f4700 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Request method failure captured: Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: DELETE /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c HTTP/1.1 Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7r8NPl9KLlLkhNOGInBRGRNd-I7oolYq-P7IATSskhixtxu9EuUSf9nALIq-WkwIyfVerYHUqQFfbM_4c8xWVZPqZ_QNvnuBw-qm8U_m0kNAcDMFsrQ2oiGjkKKHMURK4U6nm8BQS0aKQ7J_tJNyAyWOVpWRnH7JpAQKrYmW8Sanx8 Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Openstack-Nova-Api-Version: 2.20 Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: d22d9f4004394e1cbcd0a2afffd114b1 Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-46890877 Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:40:00.537362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:40:00.539906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d22d9f4004394e1cbcd0a2afffd114b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d22d9f4004394e1cbcd0a2afffd114b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d22d9f4004394e1cbcd0a2afffd114b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d22d9f4004394e1cbcd0a2afffd114b1"}]}] Aug 19 16:40:00.539906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-AttachVolumeShelveTestJSON-46890877 Aug 19 16:40:00.539906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: d22d9f4004394e1cbcd0a2afffd114b1 Aug 19 16:40:00.539906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-46890877 Aug 19 16:40:00.539906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-AttachVolumeShelveTestJSON-46890877-project Aug 19 16:40:00.539906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:40:00.539906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:40:00.539906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: e09fd34737af41dc972d806dc3b0705e Aug 19 16:40:00.539906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-AttachVolumeShelveTestJSON-46890877-project Aug 19 16:40:00.539906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:40:00.539906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance 5cf04a2f-684c-4e14-8def-16324168613c could not be found. Aug 19 16:40:00.539906 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': '5cf04a2f-684c-4e14-8def-16324168613c'} Aug 19 16:40:00.541541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:40:00.541541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:00.541541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:40:00.541541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:40:00.541541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:40:00.541541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:40:00.541541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:40:00.541541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:40:00.541541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:40:00.541541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:40:00.541541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf04a2f-684c-4e14-8def-16324168613c could not be found. Aug 19 16:40:00.541541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:00.541541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:00.541541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:00.541541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:00.541541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:00.541541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:00.541541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:40:00.541541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:40:00.541541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:40:00.543080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:40:00.543080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 16:40:00.543080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 16:40:00.543080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 16:40:00.543080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 16:40:00.543080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:40:00.543080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:40:00.543080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:40:00.543080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:40:00.543080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf04a2f-684c-4e14-8def-16324168613c could not be found. Aug 19 16:40:00.543080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:00.543080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:00.543080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:00.543080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:00.543080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:00.543080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:00.543080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:40:00.543080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:40:00.543080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf04a2f-684c-4e14-8def-16324168613c could not be found. Aug 19 16:40:00.543080 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:00.544446 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1d71f1d9-9b68-4750-a624-7692183f4700 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Returning 404 to user: Instance 5cf04a2f-684c-4e14-8def-16324168613c could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:40:00.544446 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-1d71f1d9-9b68-4750-a624-7692183f4700 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 404 len: 111 microversion: 2.20 time: 0.043131 Aug 19 16:40:00.544446 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 559/1119] 10.222.0.55 () {60 vars in 1280 bytes} [Fri Aug 19 16:40:00 2022] DELETE /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 19 16:40:00.548461 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1907c375-e518-4ae9-853d-c65681be8e39 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:00.549207 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-1907c375-e518-4ae9-853d-c65681be8e39 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 5cf04a2f-684c-4e14-8def-16324168613c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:00.555847 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1907c375-e518-4ae9-853d-c65681be8e39 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:00.556392 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1907c375-e518-4ae9-853d-c65681be8e39 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:00.556885 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1907c375-e518-4ae9-853d-c65681be8e39 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:00.557712 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1907c375-e518-4ae9-853d-c65681be8e39 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:00.558198 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1907c375-e518-4ae9-853d-c65681be8e39 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:00.558746 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1907c375-e518-4ae9-853d-c65681be8e39 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:00.574502 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-1907c375-e518-4ae9-853d-c65681be8e39 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] HTTP exception thrown: Instance 5cf04a2f-684c-4e14-8def-16324168613c could not be found. Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1907c375-e518-4ae9-853d-c65681be8e39 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Request method failure captured: Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c HTTP/1.1 Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7r8NPl9KLlLkhNOGInBRGRNd-I7oolYq-P7IATSskhixtxu9EuUSf9nALIq-WkwIyfVerYHUqQFfbM_4c8xWVZPqZ_QNvnuBw-qm8U_m0kNAcDMFsrQ2oiGjkKKHMURK4U6nm8BQS0aKQ7J_tJNyAyWOVpWRnH7JpAQKrYmW8Sanx8 Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Openstack-Nova-Api-Version: 2.20 Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: d22d9f4004394e1cbcd0a2afffd114b1 Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-46890877 Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:40:00.576062 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:40:00.577533 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d22d9f4004394e1cbcd0a2afffd114b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d22d9f4004394e1cbcd0a2afffd114b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d22d9f4004394e1cbcd0a2afffd114b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d22d9f4004394e1cbcd0a2afffd114b1"}]}] Aug 19 16:40:00.577533 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-AttachVolumeShelveTestJSON-46890877 Aug 19 16:40:00.577533 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: d22d9f4004394e1cbcd0a2afffd114b1 Aug 19 16:40:00.577533 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-46890877 Aug 19 16:40:00.577533 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-AttachVolumeShelveTestJSON-46890877-project Aug 19 16:40:00.577533 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:40:00.577533 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:40:00.577533 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: e09fd34737af41dc972d806dc3b0705e Aug 19 16:40:00.577533 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-AttachVolumeShelveTestJSON-46890877-project Aug 19 16:40:00.577533 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:40:00.577533 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance 5cf04a2f-684c-4e14-8def-16324168613c could not be found. Aug 19 16:40:00.577533 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': '5cf04a2f-684c-4e14-8def-16324168613c'} Aug 19 16:40:00.578308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:40:00.578308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:00.578308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:40:00.578308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:40:00.578308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:40:00.578308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:40:00.578308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:40:00.578308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:40:00.578308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:40:00.578308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:40:00.578308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf04a2f-684c-4e14-8def-16324168613c could not be found. Aug 19 16:40:00.578308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:00.578308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:00.578308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:00.578308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:00.578308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:00.578308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:00.578308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:40:00.578308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:40:00.578308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:40:00.579565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:40:00.579565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:40:00.579565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:40:00.579565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:40:00.579565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:40:00.579565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:40:00.579565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:40:00.579565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf04a2f-684c-4e14-8def-16324168613c could not be found. Aug 19 16:40:00.579565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:00.579565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:00.579565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:00.579565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:00.579565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:00.579565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:00.579565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:40:00.579565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:40:00.579565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf04a2f-684c-4e14-8def-16324168613c could not be found. Aug 19 16:40:00.579565 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:00.580650 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1907c375-e518-4ae9-853d-c65681be8e39 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Returning 404 to user: Instance 5cf04a2f-684c-4e14-8def-16324168613c could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:40:00.580650 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-1907c375-e518-4ae9-853d-c65681be8e39 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c" status: 404 len: 111 microversion: 2.20 time: 0.033098 Aug 19 16:40:00.583567 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 560/1120] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:40:00 2022] GET /compute/v2.1/servers/5cf04a2f-684c-4e14-8def-16324168613c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 19 16:40:00.748953 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-38787f25-96ac-4964-9976-60425977008c tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.627045 Aug 19 16:40:00.749671 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 561/1121] 10.222.0.55 () {60 vars in 1155 bytes} [Fri Aug 19 16:40:00 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 629 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 19 16:40:00.762696 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-23db8d54-393a-425e-a8ff-cbd2d98053d4 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Calling method '.version_select at 0x7fb01e152670>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:00.814835 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-23db8d54-393a-425e-a8ff-cbd2d98053d4 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/ccbad014-c7b3-42ea-9818-25444a15c0d2" status: 200 len: 343 microversion: 2.1 time: 0.055856 Aug 19 16:40:00.815673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 561/1122] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Aug 19 16:40:00 2022] GET /compute/v2.1/os-volumes/ccbad014-c7b3-42ea-9818-25444a15c0d2 => generated 343 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:40:01.770133 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-4450c694-1cea-48d5-be0e-ccb4a59adec9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:01.770695 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-4450c694-1cea-48d5-be0e-ccb4a59adec9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:01.778458 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4450c694-1cea-48d5-be0e-ccb4a59adec9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:01.778998 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4450c694-1cea-48d5-be0e-ccb4a59adec9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:01.779497 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4450c694-1cea-48d5-be0e-ccb4a59adec9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:01.780283 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4450c694-1cea-48d5-be0e-ccb4a59adec9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:01.780797 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4450c694-1cea-48d5-be0e-ccb4a59adec9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:01.781351 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4450c694-1cea-48d5-be0e-ccb4a59adec9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:01.794717 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-4450c694-1cea-48d5-be0e-ccb4a59adec9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] HTTP exception thrown: Instance 894cc1e2-8a17-4de0-8127-b929095837d8 could not be found. Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-4450c694-1cea-48d5-be0e-ccb4a59adec9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Request method failure captured: Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: DELETE /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 HTTP/1.1 Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7r8NPl9KLlLkhNOGInBRGRNd-I7oolYq-P7IATSskhixtxu9EuUSf9nALIq-WkwIyfVerYHUqQFfbM_4c8xWVZPqZ_QNvnuBw-qm8U_m0kNAcDMFsrQ2oiGjkKKHMURK4U6nm8BQS0aKQ7J_tJNyAyWOVpWRnH7JpAQKrYmW8Sanx8 Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Openstack-Nova-Api-Version: 2.20 Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: d22d9f4004394e1cbcd0a2afffd114b1 Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-46890877 Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:40:01.796297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:40:01.797762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d22d9f4004394e1cbcd0a2afffd114b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d22d9f4004394e1cbcd0a2afffd114b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d22d9f4004394e1cbcd0a2afffd114b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d22d9f4004394e1cbcd0a2afffd114b1"}]}] Aug 19 16:40:01.797762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-AttachVolumeShelveTestJSON-46890877 Aug 19 16:40:01.797762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: d22d9f4004394e1cbcd0a2afffd114b1 Aug 19 16:40:01.797762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-46890877 Aug 19 16:40:01.797762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-AttachVolumeShelveTestJSON-46890877-project Aug 19 16:40:01.797762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:40:01.797762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:40:01.797762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: e09fd34737af41dc972d806dc3b0705e Aug 19 16:40:01.797762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-AttachVolumeShelveTestJSON-46890877-project Aug 19 16:40:01.797762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:40:01.797762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance 894cc1e2-8a17-4de0-8127-b929095837d8 could not be found. Aug 19 16:40:01.797762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': '894cc1e2-8a17-4de0-8127-b929095837d8'} Aug 19 16:40:01.798476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:40:01.798476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:01.798476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:40:01.798476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:40:01.798476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:40:01.798476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:40:01.798476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:40:01.798476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:40:01.798476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:40:01.798476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:40:01.798476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 894cc1e2-8a17-4de0-8127-b929095837d8 could not be found. Aug 19 16:40:01.798476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:01.798476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:01.798476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:01.798476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:01.798476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:01.798476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:01.798476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:40:01.798476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:40:01.798476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:40:01.799646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:40:01.799646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 16:40:01.799646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 16:40:01.799646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 16:40:01.799646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 16:40:01.799646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:40:01.799646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:40:01.799646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:40:01.799646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:40:01.799646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 894cc1e2-8a17-4de0-8127-b929095837d8 could not be found. Aug 19 16:40:01.799646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:01.799646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:01.799646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:01.799646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:01.799646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:01.799646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:01.799646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:40:01.799646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:40:01.799646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 894cc1e2-8a17-4de0-8127-b929095837d8 could not be found. Aug 19 16:40:01.799646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:01.800852 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-4450c694-1cea-48d5-be0e-ccb4a59adec9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Returning 404 to user: Instance 894cc1e2-8a17-4de0-8127-b929095837d8 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:40:01.800852 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-4450c694-1cea-48d5-be0e-ccb4a59adec9 tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "DELETE /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 404 len: 111 microversion: 2.20 time: 0.032103 Aug 19 16:40:01.800852 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 562/1123] 10.222.0.55 () {60 vars in 1280 bytes} [Fri Aug 19 16:40:01 2022] DELETE /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 19 16:40:01.807800 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3d2b5f23-f4fc-4b08-a60e-bf97646b950b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:01.808566 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-3d2b5f23-f4fc-4b08-a60e-bf97646b950b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] [instance: 894cc1e2-8a17-4de0-8127-b929095837d8] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:01.810356 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:01.817772 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3d2b5f23-f4fc-4b08-a60e-bf97646b950b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:01.818249 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3d2b5f23-f4fc-4b08-a60e-bf97646b950b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:01.818682 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3d2b5f23-f4fc-4b08-a60e-bf97646b950b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:01.819367 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3d2b5f23-f4fc-4b08-a60e-bf97646b950b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:01.819817 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3d2b5f23-f4fc-4b08-a60e-bf97646b950b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:01.820236 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3d2b5f23-f4fc-4b08-a60e-bf97646b950b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:01.834464 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-fa565f91-4a5c-435d-8158-8adefe77e753 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Calling method '.version_select at 0x7fb01e30fd30>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:01.835766 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-3d2b5f23-f4fc-4b08-a60e-bf97646b950b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] HTTP exception thrown: Instance 894cc1e2-8a17-4de0-8127-b929095837d8 could not be found. Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3d2b5f23-f4fc-4b08-a60e-bf97646b950b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Request method failure captured: Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 HTTP/1.1 Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7r8NPl9KLlLkhNOGInBRGRNd-I7oolYq-P7IATSskhixtxu9EuUSf9nALIq-WkwIyfVerYHUqQFfbM_4c8xWVZPqZ_QNvnuBw-qm8U_m0kNAcDMFsrQ2oiGjkKKHMURK4U6nm8BQS0aKQ7J_tJNyAyWOVpWRnH7JpAQKrYmW8Sanx8 Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Openstack-Nova-Api-Version: 2.20 Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: d22d9f4004394e1cbcd0a2afffd114b1 Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-46890877 Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:40:01.837507 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:40:01.838952 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d22d9f4004394e1cbcd0a2afffd114b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d22d9f4004394e1cbcd0a2afffd114b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d22d9f4004394e1cbcd0a2afffd114b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d22d9f4004394e1cbcd0a2afffd114b1"}]}] Aug 19 16:40:01.838952 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-AttachVolumeShelveTestJSON-46890877 Aug 19 16:40:01.838952 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: d22d9f4004394e1cbcd0a2afffd114b1 Aug 19 16:40:01.838952 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-46890877 Aug 19 16:40:01.838952 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-AttachVolumeShelveTestJSON-46890877-project Aug 19 16:40:01.838952 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:40:01.838952 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:40:01.838952 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: e09fd34737af41dc972d806dc3b0705e Aug 19 16:40:01.838952 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-AttachVolumeShelveTestJSON-46890877-project Aug 19 16:40:01.838952 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:40:01.838952 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance 894cc1e2-8a17-4de0-8127-b929095837d8 could not be found. Aug 19 16:40:01.838952 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': '894cc1e2-8a17-4de0-8127-b929095837d8'} Aug 19 16:40:01.839673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:40:01.839673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:01.839673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:40:01.839673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:40:01.839673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:40:01.839673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:40:01.839673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:40:01.839673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:40:01.839673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:40:01.839673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:40:01.839673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 894cc1e2-8a17-4de0-8127-b929095837d8 could not be found. Aug 19 16:40:01.839673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:01.839673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:01.839673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:01.839673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:01.839673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:01.839673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:01.839673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:40:01.839673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:40:01.839673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:40:01.840894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:40:01.840894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:40:01.840894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:40:01.840894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:40:01.840894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:40:01.840894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:40:01.840894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:40:01.840894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 894cc1e2-8a17-4de0-8127-b929095837d8 could not be found. Aug 19 16:40:01.840894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:01.840894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:01.840894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:01.840894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:01.840894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:01.840894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:01.840894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:40:01.840894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:40:01.840894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 894cc1e2-8a17-4de0-8127-b929095837d8 could not be found. Aug 19 16:40:01.840894 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:01.843917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3d2b5f23-f4fc-4b08-a60e-bf97646b950b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] Returning 404 to user: Instance 894cc1e2-8a17-4de0-8127-b929095837d8 could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:40:01.845000 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3d2b5f23-f4fc-4b08-a60e-bf97646b950b tempest-AttachVolumeShelveTestJSON-46890877 tempest-AttachVolumeShelveTestJSON-46890877-project] 10.222.0.55 "GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8" status: 404 len: 111 microversion: 2.20 time: 0.042258 Aug 19 16:40:01.845925 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 562/1124] 10.222.0.55 () {60 vars in 1277 bytes} [Fri Aug 19 16:40:01 2022] GET /compute/v2.1/servers/894cc1e2-8a17-4de0-8127-b929095837d8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 19 16:40:01.912644 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-fa565f91-4a5c-435d-8158-8adefe77e753 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/ccbad014-c7b3-42ea-9818-25444a15c0d2" status: 200 len: 344 microversion: 2.1 time: 0.086068 Aug 19 16:40:01.913247 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 563/1125] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Aug 19 16:40:01 2022] GET /compute/v2.1/os-volumes/ccbad014-c7b3-42ea-9818-25444a15c0d2 => generated 344 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:40:01.925705 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3882b92e-3f9e-41e5-9145-03e260fba3a7 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Action: 'create', calling method: .version_select at 0x7fb01e099e50>, body: {"snapshot": {"volume_id": "ccbad014-c7b3-42ea-9818-25444a15c0d2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-453254961"}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:40:02.107124 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3882b92e-3f9e-41e5-9145-03e260fba3a7 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] 10.222.0.55 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.185216 Aug 19 16:40:02.108095 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 563/1126] 10.222.0.55 () {60 vars in 1162 bytes} [Fri Aug 19 16:40:01 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:40:02.127242 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-dfb315b6-1c12-46da-8704-4b45cf989fc5 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Calling method '.version_select at 0x7fb01e30f550>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:02.163242 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-dfb315b6-1c12-46da-8704-4b45cf989fc5 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/9d196997-4698-4566-a5ac-e0409dba2cb9" status: 200 len: 286 microversion: 2.1 time: 0.040543 Aug 19 16:40:02.164010 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 564/1127] 10.222.0.55 () {58 vars in 1251 bytes} [Fri Aug 19 16:40:02 2022] GET /compute/v2.1/os-snapshots/9d196997-4698-4566-a5ac-e0409dba2cb9 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:40:02.175601 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d4752b52-52d4-4d81-a73d-14bdd039e239 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Calling method '.version_select at 0x7fb022821dc0>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:02.215363 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d4752b52-52d4-4d81-a73d-14bdd039e239 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.043512 Aug 19 16:40:02.215926 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 564/1128] 10.222.0.55 () {58 vars in 1140 bytes} [Fri Aug 19 16:40:02 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:40:02.227131 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-4e684aff-5505-402d-8b4c-bf81d14bf4d5 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Calling method '.version_select at 0x7fb01e0b6700>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:02.270148 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-4e684aff-5505-402d-8b4c-bf81d14bf4d5 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/9d196997-4698-4566-a5ac-e0409dba2cb9" status: 200 len: 286 microversion: 2.1 time: 0.046859 Aug 19 16:40:02.270731 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 565/1129] 10.222.0.55 () {58 vars in 1251 bytes} [Fri Aug 19 16:40:02 2022] GET /compute/v2.1/os-snapshots/9d196997-4698-4566-a5ac-e0409dba2cb9 => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:40:03.285570 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-11090bca-611a-4c46-93d9-26b23813bdcd tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Calling method '.version_select at 0x7fb01e073430>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:03.318588 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-11090bca-611a-4c46-93d9-26b23813bdcd tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/9d196997-4698-4566-a5ac-e0409dba2cb9" status: 200 len: 286 microversion: 2.1 time: 0.039334 Aug 19 16:40:03.319353 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 565/1130] 10.222.0.55 () {58 vars in 1251 bytes} [Fri Aug 19 16:40:03 2022] GET /compute/v2.1/os-snapshots/9d196997-4698-4566-a5ac-e0409dba2cb9 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:40:04.332499 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-535f63c4-1577-4f03-bad7-bd61c08321b1 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Calling method '.version_select at 0x7fb01e30f310>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:04.368516 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-535f63c4-1577-4f03-bad7-bd61c08321b1 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/9d196997-4698-4566-a5ac-e0409dba2cb9" status: 200 len: 286 microversion: 2.1 time: 0.040792 Aug 19 16:40:04.373744 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 566/1131] 10.222.0.55 () {58 vars in 1251 bytes} [Fri Aug 19 16:40:04 2022] GET /compute/v2.1/os-snapshots/9d196997-4698-4566-a5ac-e0409dba2cb9 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:40:05.382539 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-08586b7d-8028-4e69-b1c1-e75f037924d7 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Calling method '.version_select at 0x7fb0229369d0>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:05.426386 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-08586b7d-8028-4e69-b1c1-e75f037924d7 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/9d196997-4698-4566-a5ac-e0409dba2cb9" status: 200 len: 286 microversion: 2.1 time: 0.049205 Aug 19 16:40:05.427057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 566/1132] 10.222.0.55 () {58 vars in 1251 bytes} [Fri Aug 19 16:40:05 2022] GET /compute/v2.1/os-snapshots/9d196997-4698-4566-a5ac-e0409dba2cb9 => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:40:06.439399 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c5839759-18de-46a7-9355-5ab643affa67 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Calling method '.version_select at 0x7fb01e3cea60>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:06.471981 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c5839759-18de-46a7-9355-5ab643affa67 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/9d196997-4698-4566-a5ac-e0409dba2cb9" status: 200 len: 287 microversion: 2.1 time: 0.036674 Aug 19 16:40:06.472686 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 567/1133] 10.222.0.55 () {58 vars in 1251 bytes} [Fri Aug 19 16:40:06 2022] GET /compute/v2.1/os-snapshots/9d196997-4698-4566-a5ac-e0409dba2cb9 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:40:06.484544 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-61630f75-4a5d-4e7a-9ed8-c8722276bb80 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Calling method '.version_select at 0x7fb0228d2310>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:06.549895 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-61630f75-4a5d-4e7a-9ed8-c8722276bb80 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] 10.222.0.55 "DELETE /compute/v2.1/os-snapshots/9d196997-4698-4566-a5ac-e0409dba2cb9" status: 202 len: 0 microversion: 2.1 time: 0.069774 Aug 19 16:40:06.550493 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 567/1134] 10.222.0.55 () {58 vars in 1254 bytes} [Fri Aug 19 16:40:06 2022] DELETE /compute/v2.1/os-snapshots/9d196997-4698-4566-a5ac-e0409dba2cb9 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:40:06.559731 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b24bd2a4-9687-44c4-b1ba-643835c3cf84 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Calling method '.version_select at 0x7fb01e3aeb80>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:06.593920 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b24bd2a4-9687-44c4-b1ba-643835c3cf84 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/9d196997-4698-4566-a5ac-e0409dba2cb9" status: 200 len: 286 microversion: 2.1 time: 0.038441 Aug 19 16:40:06.594476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 568/1135] 10.222.0.55 () {58 vars in 1251 bytes} [Fri Aug 19 16:40:06 2022] GET /compute/v2.1/os-snapshots/9d196997-4698-4566-a5ac-e0409dba2cb9 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:40:07.607351 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d7114f3e-bf00-48bc-9a9d-e1a912cc406c tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Calling method '.version_select at 0x7fb0229360d0>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:07.633036 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-d7114f3e-bf00-48bc-9a9d-e1a912cc406c tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] HTTP exception thrown: Snapshot 9d196997-4698-4566-a5ac-e0409dba2cb9 could not be found. Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d7114f3e-bf00-48bc-9a9d-e1a912cc406c tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Request method failure captured: Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: GET /compute/v2.1/os-snapshots/9d196997-4698-4566-a5ac-e0409dba2cb9 HTTP/1.1 Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7zgN7AMfGbco9_mPvPphSQI6UQBfyj4QS7uF7XTegfFx3oy75QX_oJa6U10eVavo6UUSnVKvN2cEcb5Kl07oIKRu4Gtsx9GoewxNRnkgH4nQYHARlUYxVuRka_5hm9A2pYYaXneyombxqcqpEMPZF_0f_euydloKmBW6La21kutnsM Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: ddc361addd644979aa650772ea10853e Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1929902325 Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:40:07.636243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:40:07.637927 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ddc361addd644979aa650772ea10853e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ddc361addd644979aa650772ea10853e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ddc361addd644979aa650772ea10853e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ddc361addd644979aa650772ea10853e"}]}] Aug 19 16:40:07.637927 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1929902325 Aug 19 16:40:07.637927 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: ddc361addd644979aa650772ea10853e Aug 19 16:40:07.637927 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1929902325 Aug 19 16:40:07.637927 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-VolumesSnapshotsTestJSON-1929902325-project Aug 19 16:40:07.637927 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:40:07.637927 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:40:07.637927 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: 46f0d7f467fd4457a31a44a68cc6af37 Aug 19 16:40:07.637927 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1929902325-project Aug 19 16:40:07.637927 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: Aug 19 16:40:07.637927 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Snapshot 9d196997-4698-4566-a5ac-e0409dba2cb9 could not be found. Aug 19 16:40:07.637927 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': '9d196997-4698-4566-a5ac-e0409dba2cb9'} Aug 19 16:40:07.637927 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:40:07.639014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:07.639014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 19 16:40:07.639014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 19 16:40:07.639014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 19 16:40:07.639014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 19 16:40:07.639014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 19 16:40:07.639014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 19 16:40:07.639014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 16:40:07.639014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 16:40:07.639014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 16:40:07.639014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 16:40:07.639014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 16:40:07.639014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 16:40:07.639014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 16:40:07.639014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 16:40:07.639014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9d196997-4698-4566-a5ac-e0409dba2cb9 could not be found. (HTTP 404) (Request-ID: req-5a1ab7d7-5312-421e-b73d-308cfc9c4a33) Aug 19 16:40:07.639014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:07.639014 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:07.640114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:07.640114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:07.640114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 19 16:40:07.640114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 19 16:40:07.640114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 16:40:07.640114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 16:40:07.640114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 19 16:40:07.640114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 19 16:40:07.640114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 16:40:07.640114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 16:40:07.640114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 19 16:40:07.640114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 19 16:40:07.640114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 19 16:40:07.640114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 19 16:40:07.640114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 19 16:40:07.640114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 19 16:40:07.640114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 16:40:07.640114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 16:40:07.640114 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 16:40:07.641281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 16:40:07.641281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 16:40:07.641281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 16:40:07.641281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 16:40:07.641281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 16:40:07.641281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9d196997-4698-4566-a5ac-e0409dba2cb9 could not be found. Aug 19 16:40:07.641281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:07.641281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:07.641281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:07.641281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:07.641281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:07.641281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:07.641281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:40:07.641281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:40:07.641281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 16:40:07.641281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 16:40:07.641281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:40:07.641281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:40:07.641281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 19 16:40:07.641281 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:40:07.642610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9d196997-4698-4566-a5ac-e0409dba2cb9 could not be found. Aug 19 16:40:07.642610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:07.642610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:07.642610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:07.642610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:07.642610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:07.642610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:07.642610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:40:07.642610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:40:07.642610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9d196997-4698-4566-a5ac-e0409dba2cb9 could not be found. Aug 19 16:40:07.642610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:07.642610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d7114f3e-bf00-48bc-9a9d-e1a912cc406c tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Returning 404 to user: Snapshot 9d196997-4698-4566-a5ac-e0409dba2cb9 could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:40:07.642610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d7114f3e-bf00-48bc-9a9d-e1a912cc406c tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/9d196997-4698-4566-a5ac-e0409dba2cb9" status: 404 len: 111 microversion: 2.1 time: 0.034894 Aug 19 16:40:07.643562 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 568/1136] 10.222.0.55 () {58 vars in 1251 bytes} [Fri Aug 19 16:40:07 2022] GET /compute/v2.1/os-snapshots/9d196997-4698-4566-a5ac-e0409dba2cb9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:40:07.649491 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-122ea41a-32a1-4faf-8e8c-b20e7c6c370c tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Calling method '.version_select at 0x7fb01e3ce9d0>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:07.715468 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-122ea41a-32a1-4faf-8e8c-b20e7c6c370c tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/ccbad014-c7b3-42ea-9818-25444a15c0d2" status: 202 len: 0 microversion: 2.1 time: 0.070305 Aug 19 16:40:07.716192 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 569/1137] 10.222.0.55 () {58 vars in 1248 bytes} [Fri Aug 19 16:40:07 2022] DELETE /compute/v2.1/os-volumes/ccbad014-c7b3-42ea-9818-25444a15c0d2 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:40:07.726958 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-63318cd8-2cac-4e02-a736-59aaf3fee23f tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Calling method '.version_select at 0x7fb01e1ce940>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:07.775678 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-63318cd8-2cac-4e02-a736-59aaf3fee23f tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/ccbad014-c7b3-42ea-9818-25444a15c0d2" status: 200 len: 343 microversion: 2.1 time: 0.054484 Aug 19 16:40:07.776734 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 569/1138] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Aug 19 16:40:07 2022] GET /compute/v2.1/os-volumes/ccbad014-c7b3-42ea-9818-25444a15c0d2 => generated 343 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:40:08.790085 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7abb96f1-dfa9-4b7e-96e2-ee54f0998750 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Calling method '.version_select at 0x7fb01e30f160>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:08.818688 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-7abb96f1-dfa9-4b7e-96e2-ee54f0998750 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] HTTP exception thrown: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7abb96f1-dfa9-4b7e-96e2-ee54f0998750 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Request method failure captured: Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: GET /compute/v2.1/os-volumes/ccbad014-c7b3-42ea-9818-25444a15c0d2 HTTP/1.1 Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7zgN7AMfGbco9_mPvPphSQI6UQBfyj4QS7uF7XTegfFx3oy75QX_oJa6U10eVavo6UUSnVKvN2cEcb5Kl07oIKRu4Gtsx9GoewxNRnkgH4nQYHARlUYxVuRka_5hm9A2pYYaXneyombxqcqpEMPZF_0f_euydloKmBW6La21kutnsM Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: ddc361addd644979aa650772ea10853e Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1929902325 Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:40:08.820619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:40:08.822879 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ddc361addd644979aa650772ea10853e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ddc361addd644979aa650772ea10853e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ddc361addd644979aa650772ea10853e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ddc361addd644979aa650772ea10853e"}]}] Aug 19 16:40:08.822879 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1929902325 Aug 19 16:40:08.822879 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: ddc361addd644979aa650772ea10853e Aug 19 16:40:08.822879 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1929902325 Aug 19 16:40:08.822879 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-VolumesSnapshotsTestJSON-1929902325-project Aug 19 16:40:08.822879 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:40:08.822879 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:40:08.822879 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: 46f0d7f467fd4457a31a44a68cc6af37 Aug 19 16:40:08.822879 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1929902325-project Aug 19 16:40:08.822879 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: Aug 19 16:40:08.822879 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. Aug 19 16:40:08.822879 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': 'ccbad014-c7b3-42ea-9818-25444a15c0d2'} Aug 19 16:40:08.822879 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:40:08.823848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:08.823848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 16:40:08.823848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 16:40:08.823848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 16:40:08.823848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 16:40:08.823848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 16:40:08.823848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 16:40:08.823848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 16:40:08.823848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 16:40:08.823848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 16:40:08.823848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 16:40:08.823848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 16:40:08.823848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 16:40:08.823848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 16:40:08.823848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 16:40:08.823848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. (HTTP 404) (Request-ID: req-e57eca90-d17c-4487-aeab-c56a87a1ead2) Aug 19 16:40:08.823848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.823848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:08.823848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.825310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:08.825310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 19 16:40:08.825310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 19 16:40:08.825310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 16:40:08.825310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 16:40:08.825310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 16:40:08.825310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 16:40:08.825310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 16:40:08.825310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 16:40:08.825310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 16:40:08.825310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 16:40:08.825310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 16:40:08.825310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 16:40:08.825310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 16:40:08.825310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 16:40:08.825310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 16:40:08.825310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 16:40:08.825310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 16:40:08.825310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 16:40:08.826608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 16:40:08.826608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 16:40:08.826608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 16:40:08.826608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 16:40:08.826608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. Aug 19 16:40:08.826608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.826608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:08.826608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.826608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:08.826608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:08.826608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:08.826608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:40:08.826608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:40:08.826608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 16:40:08.826608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 16:40:08.826608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:40:08.826608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:40:08.826608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 19 16:40:08.826608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:40:08.828004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. Aug 19 16:40:08.828004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.828004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:08.828004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.828004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:08.828004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:08.828004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:08.828004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:40:08.828004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:40:08.828004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. Aug 19 16:40:08.828004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.828004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7abb96f1-dfa9-4b7e-96e2-ee54f0998750 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Returning 404 to user: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:40:08.828004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7abb96f1-dfa9-4b7e-96e2-ee54f0998750 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/ccbad014-c7b3-42ea-9818-25444a15c0d2" status: 404 len: 109 microversion: 2.1 time: 0.036944 Aug 19 16:40:08.828004 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 570/1139] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Aug 19 16:40:08 2022] GET /compute/v2.1/os-volumes/ccbad014-c7b3-42ea-9818-25444a15c0d2 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:40:08.833721 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3280e1cd-5c57-4e8e-852a-23deaa1a8274 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Calling method '.version_select at 0x7fb022936820>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:08.861649 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-3280e1cd-5c57-4e8e-852a-23deaa1a8274 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] HTTP exception thrown: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3280e1cd-5c57-4e8e-852a-23deaa1a8274 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Request method failure captured: Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: DELETE /compute/v2.1/os-volumes/ccbad014-c7b3-42ea-9818-25444a15c0d2 HTTP/1.1 Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7zgN7AMfGbco9_mPvPphSQI6UQBfyj4QS7uF7XTegfFx3oy75QX_oJa6U10eVavo6UUSnVKvN2cEcb5Kl07oIKRu4Gtsx9GoewxNRnkgH4nQYHARlUYxVuRka_5hm9A2pYYaXneyombxqcqpEMPZF_0f_euydloKmBW6La21kutnsM Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: ddc361addd644979aa650772ea10853e Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1929902325 Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:40:08.863947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:40:08.865634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ddc361addd644979aa650772ea10853e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ddc361addd644979aa650772ea10853e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ddc361addd644979aa650772ea10853e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ddc361addd644979aa650772ea10853e"}]}] Aug 19 16:40:08.865634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1929902325 Aug 19 16:40:08.865634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: ddc361addd644979aa650772ea10853e Aug 19 16:40:08.865634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1929902325 Aug 19 16:40:08.865634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-VolumesSnapshotsTestJSON-1929902325-project Aug 19 16:40:08.865634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:40:08.865634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:40:08.865634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: 46f0d7f467fd4457a31a44a68cc6af37 Aug 19 16:40:08.865634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1929902325-project Aug 19 16:40:08.865634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: Aug 19 16:40:08.865634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. Aug 19 16:40:08.865634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': 'ccbad014-c7b3-42ea-9818-25444a15c0d2'} Aug 19 16:40:08.865634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:40:08.866610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:08.866610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 16:40:08.866610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 16:40:08.866610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 19 16:40:08.866610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 19 16:40:08.866610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 19 16:40:08.866610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 19 16:40:08.866610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 19 16:40:08.866610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 19 16:40:08.866610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 19 16:40:08.866610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 19 16:40:08.866610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 16:40:08.866610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 16:40:08.866610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 16:40:08.866610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 16:40:08.866610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. (HTTP 404) (Request-ID: req-84cdd748-54f3-4cd9-8803-3de725196f81) Aug 19 16:40:08.866610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.866610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:08.866610 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.868586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:08.868586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 19 16:40:08.868586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 19 16:40:08.868586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 16:40:08.868586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 16:40:08.868586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 16:40:08.868586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 16:40:08.868586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 16:40:08.868586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 16:40:08.868586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 16:40:08.868586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 16:40:08.868586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 19 16:40:08.868586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 19 16:40:08.868586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 19 16:40:08.868586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 19 16:40:08.868586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 19 16:40:08.868586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 19 16:40:08.868586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 19 16:40:08.868586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 19 16:40:08.870299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 16:40:08.870299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 16:40:08.870299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 16:40:08.870299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 16:40:08.870299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. Aug 19 16:40:08.870299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.870299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:08.870299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.870299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:08.870299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:08.870299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:08.870299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:40:08.870299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:40:08.870299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 16:40:08.870299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 16:40:08.870299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:40:08.870299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:40:08.870299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 19 16:40:08.870299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:40:08.872146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. Aug 19 16:40:08.872146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.872146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:08.872146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.872146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:08.872146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:08.872146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:08.872146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:40:08.872146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:40:08.872146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. Aug 19 16:40:08.872146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.872146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3280e1cd-5c57-4e8e-852a-23deaa1a8274 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Returning 404 to user: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:40:08.872146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3280e1cd-5c57-4e8e-852a-23deaa1a8274 tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/ccbad014-c7b3-42ea-9818-25444a15c0d2" status: 404 len: 109 microversion: 2.1 time: 0.036121 Aug 19 16:40:08.873278 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 570/1140] 10.222.0.55 () {58 vars in 1248 bytes} [Fri Aug 19 16:40:08 2022] DELETE /compute/v2.1/os-volumes/ccbad014-c7b3-42ea-9818-25444a15c0d2 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:40:08.876320 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e48d5d13-e74d-42a3-bc5a-fe019189dd9e tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Calling method '.version_select at 0x7fb01e2fa550>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:08.903897 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-e48d5d13-e74d-42a3-bc5a-fe019189dd9e tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] HTTP exception thrown: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e48d5d13-e74d-42a3-bc5a-fe019189dd9e tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Request method failure captured: Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: GET /compute/v2.1/os-volumes/ccbad014-c7b3-42ea-9818-25444a15c0d2 HTTP/1.1 Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7zgN7AMfGbco9_mPvPphSQI6UQBfyj4QS7uF7XTegfFx3oy75QX_oJa6U10eVavo6UUSnVKvN2cEcb5Kl07oIKRu4Gtsx9GoewxNRnkgH4nQYHARlUYxVuRka_5hm9A2pYYaXneyombxqcqpEMPZF_0f_euydloKmBW6La21kutnsM Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: ddc361addd644979aa650772ea10853e Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1929902325 Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:40:08.906689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:40:08.908574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ddc361addd644979aa650772ea10853e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ddc361addd644979aa650772ea10853e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ddc361addd644979aa650772ea10853e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ddc361addd644979aa650772ea10853e"}]}] Aug 19 16:40:08.908574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1929902325 Aug 19 16:40:08.908574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: ddc361addd644979aa650772ea10853e Aug 19 16:40:08.908574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1929902325 Aug 19 16:40:08.908574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-VolumesSnapshotsTestJSON-1929902325-project Aug 19 16:40:08.908574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:40:08.908574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:40:08.908574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: 46f0d7f467fd4457a31a44a68cc6af37 Aug 19 16:40:08.908574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1929902325-project Aug 19 16:40:08.908574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: Aug 19 16:40:08.908574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. Aug 19 16:40:08.908574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': 'ccbad014-c7b3-42ea-9818-25444a15c0d2'} Aug 19 16:40:08.908574 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:40:08.909504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:08.909504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 16:40:08.909504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 16:40:08.909504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 16:40:08.909504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 16:40:08.909504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 16:40:08.909504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 16:40:08.909504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 16:40:08.909504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 16:40:08.909504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 16:40:08.909504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 16:40:08.909504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 16:40:08.909504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 16:40:08.909504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 16:40:08.909504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 16:40:08.909504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. (HTTP 404) (Request-ID: req-1b55c61a-4f8d-4cd7-a74e-2ca49b02100d) Aug 19 16:40:08.909504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.909504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:08.909504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.910994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:08.910994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 19 16:40:08.910994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 19 16:40:08.910994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 16:40:08.910994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 16:40:08.910994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 16:40:08.910994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 16:40:08.910994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 16:40:08.910994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 16:40:08.910994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 16:40:08.910994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 16:40:08.910994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 16:40:08.910994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 16:40:08.910994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 16:40:08.910994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 16:40:08.910994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 16:40:08.910994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 16:40:08.910994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 16:40:08.910994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 16:40:08.912429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 16:40:08.912429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 16:40:08.912429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 16:40:08.912429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 16:40:08.912429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. Aug 19 16:40:08.912429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.912429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:08.912429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.912429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:08.912429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:08.912429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:08.912429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:40:08.912429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:40:08.912429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 16:40:08.912429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 16:40:08.912429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:40:08.912429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:40:08.912429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 19 16:40:08.912429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:40:08.913827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. Aug 19 16:40:08.913827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.913827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:08.913827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.913827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:08.913827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:08.913827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:08.913827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:40:08.913827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:40:08.913827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. Aug 19 16:40:08.913827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:08.913827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e48d5d13-e74d-42a3-bc5a-fe019189dd9e tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] Returning 404 to user: Volume ccbad014-c7b3-42ea-9818-25444a15c0d2 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:40:08.913827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e48d5d13-e74d-42a3-bc5a-fe019189dd9e tempest-VolumesSnapshotsTestJSON-1929902325 tempest-VolumesSnapshotsTestJSON-1929902325-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/ccbad014-c7b3-42ea-9818-25444a15c0d2" status: 404 len: 109 microversion: 2.1 time: 0.036553 Aug 19 16:40:08.913827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 571/1141] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Aug 19 16:40:08 2022] GET /compute/v2.1/os-volumes/ccbad014-c7b3-42ea-9818-25444a15c0d2 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:40:10.532338 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-92871252-3038-42c2-a4ae-d0eb8aa722eb tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] Action: 'create', calling method: .version_select at 0x7fb022936790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-541444682", "metadata": {"Type": "work"}}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-92871252-3038-42c2-a4ae-d0eb8aa722eb tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] Request method failure captured: Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 121 Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7zqtS9k9IuD_D5wxSwjFtVgozXZXnAC6rf57QQEzfA0s9qBvMOGfmGLMKqOqYsiORslaHFHSXGu6MZLyz-ZqQ8U9xtWHZ1ZthtCNwRXfmd1PEhXTNQ6MnrAONlc2g5Lccic_j-en1fxCI6XsU3gMP5nrTISRcFmDzCPIEP7PSOdN5c Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: dff5f7011c6b46fa89fcfa54a74f91d9 Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-VolumesNegativeTest-1914869110 Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:40:10.543289 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:40:10.544774 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dff5f7011c6b46fa89fcfa54a74f91d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dff5f7011c6b46fa89fcfa54a74f91d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dff5f7011c6b46fa89fcfa54a74f91d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dff5f7011c6b46fa89fcfa54a74f91d9"}]}] Aug 19 16:40:10.544774 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-VolumesNegativeTest-1914869110 Aug 19 16:40:10.544774 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: dff5f7011c6b46fa89fcfa54a74f91d9 Aug 19 16:40:10.544774 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-VolumesNegativeTest-1914869110 Aug 19 16:40:10.544774 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-VolumesNegativeTest-1914869110-project Aug 19 16:40:10.544774 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:40:10.544774 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:40:10.544774 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: 266b16b12a034e94876519eb492623e6 Aug 19 16:40:10.544774 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-VolumesNegativeTest-1914869110-project Aug 19 16:40:10.544774 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Aug 19 16:40:10.544774 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-541444682", "metadata": {"Type": "work"}}} Aug 19 16:40:10.544774 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: Aug 19 16:40:10.544774 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-541444682', 'metadata': {'Type': 'work'}}}} Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise error Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi '#$%' Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:40:10.545689 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:40:10.547092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 16:40:10.547092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 16:40:10.547092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:40:10.547092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:40:10.547092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 19 16:40:10.547092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 19 16:40:10.547092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 19 16:40:10.547092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 19 16:40:10.547092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 19 16:40:10.547092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 19 16:40:10.547092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 19 16:40:10.547092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.547092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:10.547092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.547092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.547092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:10.547092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:10.547092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 19 16:40:10.547092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 19 16:40:10.548316 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 19 16:40:10.548316 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.548316 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-92871252-3038-42c2-a4ae-d0eb8aa722eb tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:40:10.548316 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-92871252-3038-42c2-a4ae-d0eb8aa722eb tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.132164 Aug 19 16:40:10.548316 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 571/1142] 10.222.0.55 () {60 vars in 1156 bytes} [Fri Aug 19 16:40:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 19 16:40:10.554964 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b4a2e6fc-7834-4d8d-b4db-1ecb806530e5 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] Action: 'create', calling method: .version_select at 0x7fb01e3ae790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-677704336", "metadata": {"Type": "work"}}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b4a2e6fc-7834-4d8d-b4db-1ecb806530e5 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] Request method failure captured: Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 119 Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7zqtS9k9IuD_D5wxSwjFtVgozXZXnAC6rf57QQEzfA0s9qBvMOGfmGLMKqOqYsiORslaHFHSXGu6MZLyz-ZqQ8U9xtWHZ1ZthtCNwRXfmd1PEhXTNQ6MnrAONlc2g5Lccic_j-en1fxCI6XsU3gMP5nrTISRcFmDzCPIEP7PSOdN5c Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: dff5f7011c6b46fa89fcfa54a74f91d9 Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-VolumesNegativeTest-1914869110 Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:40:10.560471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:40:10.562163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dff5f7011c6b46fa89fcfa54a74f91d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dff5f7011c6b46fa89fcfa54a74f91d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dff5f7011c6b46fa89fcfa54a74f91d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dff5f7011c6b46fa89fcfa54a74f91d9"}]}] Aug 19 16:40:10.562163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-VolumesNegativeTest-1914869110 Aug 19 16:40:10.562163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: dff5f7011c6b46fa89fcfa54a74f91d9 Aug 19 16:40:10.562163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-VolumesNegativeTest-1914869110 Aug 19 16:40:10.562163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-VolumesNegativeTest-1914869110-project Aug 19 16:40:10.562163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:40:10.562163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:40:10.562163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: 266b16b12a034e94876519eb492623e6 Aug 19 16:40:10.562163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-VolumesNegativeTest-1914869110-project Aug 19 16:40:10.562163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Aug 19 16:40:10.562163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-677704336", "metadata": {"Type": "work"}}} Aug 19 16:40:10.562163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: Aug 19 16:40:10.562163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-677704336', 'metadata': {'Type': 'work'}}}} Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise error Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi '0' Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:40:10.563447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:40:10.565164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 16:40:10.565164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 16:40:10.565164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:40:10.565164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:40:10.565164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 19 16:40:10.565164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 19 16:40:10.565164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 19 16:40:10.565164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 19 16:40:10.565164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 19 16:40:10.565164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 19 16:40:10.565164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 19 16:40:10.565164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.565164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:10.565164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.565164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.565164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:10.565164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:10.565164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 19 16:40:10.565164 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 19 16:40:10.566360 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 19 16:40:10.566360 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.566360 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b4a2e6fc-7834-4d8d-b4db-1ecb806530e5 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:40:10.566360 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b4a2e6fc-7834-4d8d-b4db-1ecb806530e5 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011212 Aug 19 16:40:10.566360 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 572/1143] 10.222.0.55 () {60 vars in 1156 bytes} [Fri Aug 19 16:40:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 19 16:40:10.572548 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-dd4bbad9-282b-4804-b01a-b78ebf2ce9e2 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] Action: 'create', calling method: .version_select at 0x7fb01e49f160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1833799553", "metadata": {"Type": "work"}}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-dd4bbad9-282b-4804-b01a-b78ebf2ce9e2 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] Request method failure captured: Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 119 Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7zqtS9k9IuD_D5wxSwjFtVgozXZXnAC6rf57QQEzfA0s9qBvMOGfmGLMKqOqYsiORslaHFHSXGu6MZLyz-ZqQ8U9xtWHZ1ZthtCNwRXfmd1PEhXTNQ6MnrAONlc2g5Lccic_j-en1fxCI6XsU3gMP5nrTISRcFmDzCPIEP7PSOdN5c Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: dff5f7011c6b46fa89fcfa54a74f91d9 Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-VolumesNegativeTest-1914869110 Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:40:10.576218 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:40:10.578111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dff5f7011c6b46fa89fcfa54a74f91d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dff5f7011c6b46fa89fcfa54a74f91d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dff5f7011c6b46fa89fcfa54a74f91d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dff5f7011c6b46fa89fcfa54a74f91d9"}]}] Aug 19 16:40:10.578111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-VolumesNegativeTest-1914869110 Aug 19 16:40:10.578111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: dff5f7011c6b46fa89fcfa54a74f91d9 Aug 19 16:40:10.578111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-VolumesNegativeTest-1914869110 Aug 19 16:40:10.578111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-VolumesNegativeTest-1914869110-project Aug 19 16:40:10.578111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:40:10.578111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:40:10.578111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: 266b16b12a034e94876519eb492623e6 Aug 19 16:40:10.578111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-VolumesNegativeTest-1914869110-project Aug 19 16:40:10.578111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Aug 19 16:40:10.578111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1833799553", "metadata": {"Type": "work"}}} Aug 19 16:40:10.578111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: Aug 19 16:40:10.578111 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1833799553', 'metadata': {'Type': 'work'}}}} Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise error Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi '' Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:40:10.579214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:40:10.580706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 16:40:10.580706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 16:40:10.580706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:40:10.580706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:40:10.580706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 19 16:40:10.580706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 19 16:40:10.580706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 19 16:40:10.580706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 19 16:40:10.580706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 19 16:40:10.580706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 19 16:40:10.580706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 19 16:40:10.580706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.580706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:10.580706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.580706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.580706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:10.580706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:10.580706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 19 16:40:10.580706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 19 16:40:10.582330 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 19 16:40:10.582330 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.582330 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-dd4bbad9-282b-4804-b01a-b78ebf2ce9e2 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:40:10.582330 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-dd4bbad9-282b-4804-b01a-b78ebf2ce9e2 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009568 Aug 19 16:40:10.582330 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 572/1144] 10.222.0.55 () {60 vars in 1156 bytes} [Fri Aug 19 16:40:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 19 16:40:10.588640 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ec8b1baa-80e7-41f4-8046-337f2536aa25 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] Calling method '.version_select at 0x7fb01e3ceaf0>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:10.616361 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-ec8b1baa-80e7-41f4-8046-337f2536aa25 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] HTTP exception thrown: Volume tempest-invalid-1373058195 could not be found. Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ec8b1baa-80e7-41f4-8046-337f2536aa25 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] Request method failure captured: Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1373058195 HTTP/1.1 Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7zqtS9k9IuD_D5wxSwjFtVgozXZXnAC6rf57QQEzfA0s9qBvMOGfmGLMKqOqYsiORslaHFHSXGu6MZLyz-ZqQ8U9xtWHZ1ZthtCNwRXfmd1PEhXTNQ6MnrAONlc2g5Lccic_j-en1fxCI6XsU3gMP5nrTISRcFmDzCPIEP7PSOdN5c Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: dff5f7011c6b46fa89fcfa54a74f91d9 Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-VolumesNegativeTest-1914869110 Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:40:10.618894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:40:10.620460 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dff5f7011c6b46fa89fcfa54a74f91d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dff5f7011c6b46fa89fcfa54a74f91d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dff5f7011c6b46fa89fcfa54a74f91d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dff5f7011c6b46fa89fcfa54a74f91d9"}]}] Aug 19 16:40:10.620460 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-VolumesNegativeTest-1914869110 Aug 19 16:40:10.620460 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: dff5f7011c6b46fa89fcfa54a74f91d9 Aug 19 16:40:10.620460 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-VolumesNegativeTest-1914869110 Aug 19 16:40:10.620460 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-VolumesNegativeTest-1914869110-project Aug 19 16:40:10.620460 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:40:10.620460 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:40:10.620460 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: 266b16b12a034e94876519eb492623e6 Aug 19 16:40:10.620460 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-VolumesNegativeTest-1914869110-project Aug 19 16:40:10.620460 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: Aug 19 16:40:10.620460 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Volume tempest-invalid-1373058195 could not be found. Aug 19 16:40:10.620460 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': 'tempest-invalid-1373058195'} Aug 19 16:40:10.620460 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:40:10.621719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.621719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 16:40:10.621719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 16:40:10.621719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 19 16:40:10.621719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 19 16:40:10.621719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 19 16:40:10.621719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 19 16:40:10.621719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 19 16:40:10.621719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 19 16:40:10.621719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 19 16:40:10.621719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 19 16:40:10.621719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 16:40:10.621719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 16:40:10.621719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 16:40:10.621719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 16:40:10.621719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1373058195 could not be found. (HTTP 404) (Request-ID: req-add87375-1788-4a39-9364-bbf698f06d94) Aug 19 16:40:10.621719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.621719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:10.621719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.623097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.623097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 19 16:40:10.623097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 19 16:40:10.623097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 16:40:10.623097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 16:40:10.623097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 16:40:10.623097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 16:40:10.623097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 16:40:10.623097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 16:40:10.623097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 16:40:10.623097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 16:40:10.623097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 19 16:40:10.623097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 19 16:40:10.623097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 19 16:40:10.623097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 19 16:40:10.623097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 19 16:40:10.623097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 19 16:40:10.623097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 19 16:40:10.623097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 19 16:40:10.624302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 16:40:10.624302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 16:40:10.624302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 16:40:10.624302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 16:40:10.624302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1373058195 could not be found. Aug 19 16:40:10.624302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.624302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:10.624302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.624302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.624302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:10.624302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:10.624302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:40:10.624302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:40:10.624302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 16:40:10.624302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 16:40:10.624302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:40:10.624302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:40:10.624302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 19 16:40:10.624302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:40:10.624302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1373058195 could not be found. Aug 19 16:40:10.625673 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.625673 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:10.625673 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.625673 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.625673 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:10.625673 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:10.625673 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:40:10.625673 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:40:10.625673 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1373058195 could not be found. Aug 19 16:40:10.625673 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.625673 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ec8b1baa-80e7-41f4-8046-337f2536aa25 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] Returning 404 to user: Volume tempest-invalid-1373058195 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:40:10.625673 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ec8b1baa-80e7-41f4-8046-337f2536aa25 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1373058195" status: 404 len: 99 microversion: 2.1 time: 0.035617 Aug 19 16:40:10.625673 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 573/1145] 10.222.0.55 () {58 vars in 1218 bytes} [Fri Aug 19 16:40:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1373058195 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 19 16:40:10.630577 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c41f428c-7c10-41c6-929f-42ec2603f6b9 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004430 Aug 19 16:40:10.631072 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 573/1146] 10.222.0.55 () {58 vars in 1140 bytes} [Fri Aug 19 16:40:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 19 16:40:10.640527 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f9e98b5b-c900-492b-84c9-48a03be68aa4 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004277 Aug 19 16:40:10.641100 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 574/1147] 10.222.0.55 () {58 vars in 1137 bytes} [Fri Aug 19 16:40:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 19 16:40:10.650186 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e057bb9e-867b-48c7-9ab9-7a7f4447d417 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] Calling method '.version_select at 0x7fb01e1d1af0>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:10.677804 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-e057bb9e-867b-48c7-9ab9-7a7f4447d417 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] HTTP exception thrown: Volume a9cd9811-a6dd-4a5a-8c3a-737a0bc6d26f could not be found. Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e057bb9e-867b-48c7-9ab9-7a7f4447d417 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] Request method failure captured: Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: DELETE /compute/v2.1/os-volumes/a9cd9811-a6dd-4a5a-8c3a-737a0bc6d26f HTTP/1.1 Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7zqtS9k9IuD_D5wxSwjFtVgozXZXnAC6rf57QQEzfA0s9qBvMOGfmGLMKqOqYsiORslaHFHSXGu6MZLyz-ZqQ8U9xtWHZ1ZthtCNwRXfmd1PEhXTNQ6MnrAONlc2g5Lccic_j-en1fxCI6XsU3gMP5nrTISRcFmDzCPIEP7PSOdN5c Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: dff5f7011c6b46fa89fcfa54a74f91d9 Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-VolumesNegativeTest-1914869110 Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:40:10.679751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:40:10.681860 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dff5f7011c6b46fa89fcfa54a74f91d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dff5f7011c6b46fa89fcfa54a74f91d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dff5f7011c6b46fa89fcfa54a74f91d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dff5f7011c6b46fa89fcfa54a74f91d9"}]}] Aug 19 16:40:10.681860 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-VolumesNegativeTest-1914869110 Aug 19 16:40:10.681860 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: dff5f7011c6b46fa89fcfa54a74f91d9 Aug 19 16:40:10.681860 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-VolumesNegativeTest-1914869110 Aug 19 16:40:10.681860 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-VolumesNegativeTest-1914869110-project Aug 19 16:40:10.681860 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:40:10.681860 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:40:10.681860 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: 266b16b12a034e94876519eb492623e6 Aug 19 16:40:10.681860 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-VolumesNegativeTest-1914869110-project Aug 19 16:40:10.681860 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: Aug 19 16:40:10.681860 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Volume a9cd9811-a6dd-4a5a-8c3a-737a0bc6d26f could not be found. Aug 19 16:40:10.681860 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': 'a9cd9811-a6dd-4a5a-8c3a-737a0bc6d26f'} Aug 19 16:40:10.681860 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:40:10.682968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.682968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 16:40:10.682968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 16:40:10.682968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 19 16:40:10.682968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 19 16:40:10.682968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 19 16:40:10.682968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 19 16:40:10.682968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 19 16:40:10.682968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 19 16:40:10.682968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 19 16:40:10.682968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 19 16:40:10.682968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 16:40:10.682968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 16:40:10.682968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 16:40:10.682968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 16:40:10.682968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a9cd9811-a6dd-4a5a-8c3a-737a0bc6d26f could not be found. (HTTP 404) (Request-ID: req-431b3990-ffec-4f20-b420-d00f0806ad28) Aug 19 16:40:10.682968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.682968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:10.682968 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.684450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.684450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 19 16:40:10.684450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 19 16:40:10.684450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 16:40:10.684450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 16:40:10.684450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 16:40:10.684450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 16:40:10.684450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 16:40:10.684450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 16:40:10.684450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 16:40:10.684450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 16:40:10.684450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 19 16:40:10.684450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 19 16:40:10.684450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 19 16:40:10.684450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 19 16:40:10.684450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 19 16:40:10.684450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 19 16:40:10.684450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 19 16:40:10.684450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 19 16:40:10.685715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 16:40:10.685715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 16:40:10.685715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 16:40:10.685715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 16:40:10.685715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a9cd9811-a6dd-4a5a-8c3a-737a0bc6d26f could not be found. Aug 19 16:40:10.685715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.685715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:10.685715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.685715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.685715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:10.685715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:10.685715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:40:10.685715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:40:10.685715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 16:40:10.685715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 16:40:10.685715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:40:10.685715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:40:10.685715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 19 16:40:10.685715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:40:10.687182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a9cd9811-a6dd-4a5a-8c3a-737a0bc6d26f could not be found. Aug 19 16:40:10.687182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.687182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:10.687182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.687182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.687182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:10.687182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:10.687182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:40:10.687182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:40:10.687182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a9cd9811-a6dd-4a5a-8c3a-737a0bc6d26f could not be found. Aug 19 16:40:10.687182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.687182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e057bb9e-867b-48c7-9ab9-7a7f4447d417 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] Returning 404 to user: Volume a9cd9811-a6dd-4a5a-8c3a-737a0bc6d26f could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:40:10.687182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e057bb9e-867b-48c7-9ab9-7a7f4447d417 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/a9cd9811-a6dd-4a5a-8c3a-737a0bc6d26f" status: 404 len: 109 microversion: 2.1 time: 0.034832 Aug 19 16:40:10.687182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 574/1148] 10.222.0.55 () {58 vars in 1248 bytes} [Fri Aug 19 16:40:10 2022] DELETE /compute/v2.1/os-volumes/a9cd9811-a6dd-4a5a-8c3a-737a0bc6d26f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:40:10.692988 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-05e48a22-7c75-4c99-a6aa-65d02094f438 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] Calling method '.version_select at 0x7fb01e33a940>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:10.724639 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-05e48a22-7c75-4c99-a6aa-65d02094f438 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] HTTP exception thrown: Volume 21a46604-0abe-4017-8805-9c09b2910180 could not be found. Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-05e48a22-7c75-4c99-a6aa-65d02094f438 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] Request method failure captured: Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: GET /compute/v2.1/os-volumes/21a46604-0abe-4017-8805-9c09b2910180 HTTP/1.1 Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7zqtS9k9IuD_D5wxSwjFtVgozXZXnAC6rf57QQEzfA0s9qBvMOGfmGLMKqOqYsiORslaHFHSXGu6MZLyz-ZqQ8U9xtWHZ1ZthtCNwRXfmd1PEhXTNQ6MnrAONlc2g5Lccic_j-en1fxCI6XsU3gMP5nrTISRcFmDzCPIEP7PSOdN5c Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: dff5f7011c6b46fa89fcfa54a74f91d9 Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-VolumesNegativeTest-1914869110 Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:40:10.726666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:40:10.728208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dff5f7011c6b46fa89fcfa54a74f91d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dff5f7011c6b46fa89fcfa54a74f91d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dff5f7011c6b46fa89fcfa54a74f91d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dff5f7011c6b46fa89fcfa54a74f91d9"}]}] Aug 19 16:40:10.728208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-VolumesNegativeTest-1914869110 Aug 19 16:40:10.728208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: dff5f7011c6b46fa89fcfa54a74f91d9 Aug 19 16:40:10.728208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-VolumesNegativeTest-1914869110 Aug 19 16:40:10.728208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-VolumesNegativeTest-1914869110-project Aug 19 16:40:10.728208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:40:10.728208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:40:10.728208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: 266b16b12a034e94876519eb492623e6 Aug 19 16:40:10.728208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-VolumesNegativeTest-1914869110-project Aug 19 16:40:10.728208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: Aug 19 16:40:10.728208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Volume 21a46604-0abe-4017-8805-9c09b2910180 could not be found. Aug 19 16:40:10.728208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': '21a46604-0abe-4017-8805-9c09b2910180'} Aug 19 16:40:10.728208 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:40:10.729199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.729199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 16:40:10.729199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 16:40:10.729199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 16:40:10.729199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 16:40:10.729199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 16:40:10.729199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 16:40:10.729199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 16:40:10.729199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 16:40:10.729199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 16:40:10.729199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 16:40:10.729199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 16:40:10.729199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 16:40:10.729199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 16:40:10.729199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 16:40:10.729199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 21a46604-0abe-4017-8805-9c09b2910180 could not be found. (HTTP 404) (Request-ID: req-a805b42c-4064-4bef-a26f-1f4e5806238a) Aug 19 16:40:10.729199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.729199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:10.729199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.730693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.730693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 19 16:40:10.730693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 19 16:40:10.730693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 19 16:40:10.730693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 19 16:40:10.730693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 19 16:40:10.730693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 19 16:40:10.730693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 19 16:40:10.730693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 19 16:40:10.730693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 19 16:40:10.730693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 19 16:40:10.730693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 19 16:40:10.730693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 19 16:40:10.730693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 19 16:40:10.730693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 19 16:40:10.730693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 19 16:40:10.730693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 19 16:40:10.730693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 19 16:40:10.730693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 19 16:40:10.732025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 19 16:40:10.732025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 19 16:40:10.732025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 19 16:40:10.732025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 19 16:40:10.732025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 21a46604-0abe-4017-8805-9c09b2910180 could not be found. Aug 19 16:40:10.732025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.732025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:10.732025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.732025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.732025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:10.732025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:10.732025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:40:10.732025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:40:10.732025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 19 16:40:10.732025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 19 16:40:10.732025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:40:10.732025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:40:10.732025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 19 16:40:10.732025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:40:10.733398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 21a46604-0abe-4017-8805-9c09b2910180 could not be found. Aug 19 16:40:10.733398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.733398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:10.733398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.733398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:10.733398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:10.733398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:10.733398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:40:10.733398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:40:10.733398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 21a46604-0abe-4017-8805-9c09b2910180 could not be found. Aug 19 16:40:10.733398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:40:10.733398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-05e48a22-7c75-4c99-a6aa-65d02094f438 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] Returning 404 to user: Volume 21a46604-0abe-4017-8805-9c09b2910180 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:40:10.733398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-05e48a22-7c75-4c99-a6aa-65d02094f438 tempest-VolumesNegativeTest-1914869110 tempest-VolumesNegativeTest-1914869110-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/21a46604-0abe-4017-8805-9c09b2910180" status: 404 len: 109 microversion: 2.1 time: 0.040307 Aug 19 16:40:10.733398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 575/1149] 10.222.0.55 () {58 vars in 1245 bytes} [Fri Aug 19 16:40:10 2022] GET /compute/v2.1/os-volumes/21a46604-0abe-4017-8805-9c09b2910180 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:40:12.518915 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:12.519606 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:12.524035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-500593ce-cd91-49f3-b6a1-3a5e083ab25b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:12.525542 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-500593ce-cd91-49f3-b6a1-3a5e083ab25b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:12.534848 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-500593ce-cd91-49f3-b6a1-3a5e083ab25b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:12.534848 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-500593ce-cd91-49f3-b6a1-3a5e083ab25b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:12.534848 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-500593ce-cd91-49f3-b6a1-3a5e083ab25b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:12.545132 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-500593ce-cd91-49f3-b6a1-3a5e083ab25b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:12.545629 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-500593ce-cd91-49f3-b6a1-3a5e083ab25b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:12.546070 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-500593ce-cd91-49f3-b6a1-3a5e083ab25b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:12.609103 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-500593ce-cd91-49f3-b6a1-3a5e083ab25b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Going to try to terminate instance {{(pid=127285) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:40:12.706426 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-500593ce-cd91-49f3-b6a1-3a5e083ab25b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 204 len: 0 microversion: 2.1 time: 0.188366 Aug 19 16:40:12.708611 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 575/1150] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:40:12 2022] DELETE /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:40:12.714265 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:12.715568 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=17 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:12.720379 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f5946f66-aaa3-4797-bf78-f472638cdb5d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:12.721207 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f5946f66-aaa3-4797-bf78-f472638cdb5d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:12.731287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f5946f66-aaa3-4797-bf78-f472638cdb5d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:12.732078 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f5946f66-aaa3-4797-bf78-f472638cdb5d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:12.732663 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f5946f66-aaa3-4797-bf78-f472638cdb5d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:12.733603 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f5946f66-aaa3-4797-bf78-f472638cdb5d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:12.734056 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f5946f66-aaa3-4797-bf78-f472638cdb5d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:12.734544 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f5946f66-aaa3-4797-bf78-f472638cdb5d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:12.968403 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f5946f66-aaa3-4797-bf78-f472638cdb5d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:12.976562 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f5946f66-aaa3-4797-bf78-f472638cdb5d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1578 microversion: 2.1 time: 0.263916 Aug 19 16:40:12.980952 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 576/1151] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:12 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1578 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:13.999737 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-71a048a5-394b-47d9-af36-9a4f53bdfbe8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:14.000466 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-71a048a5-394b-47d9-af36-9a4f53bdfbe8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:14.007678 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-71a048a5-394b-47d9-af36-9a4f53bdfbe8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:14.008171 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-71a048a5-394b-47d9-af36-9a4f53bdfbe8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:14.008616 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-71a048a5-394b-47d9-af36-9a4f53bdfbe8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:14.009841 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-71a048a5-394b-47d9-af36-9a4f53bdfbe8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:14.010298 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-71a048a5-394b-47d9-af36-9a4f53bdfbe8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:14.010730 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-71a048a5-394b-47d9-af36-9a4f53bdfbe8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:14.418283 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-71a048a5-394b-47d9-af36-9a4f53bdfbe8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:14.426681 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-71a048a5-394b-47d9-af36-9a4f53bdfbe8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1578 microversion: 2.1 time: 0.431292 Aug 19 16:40:14.427262 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 576/1152] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:13 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1578 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:15.449490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-db2f99c8-ca17-4259-9d20-77eeda6aee6e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:15.450104 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-db2f99c8-ca17-4259-9d20-77eeda6aee6e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:15.456224 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-db2f99c8-ca17-4259-9d20-77eeda6aee6e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:15.456710 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-db2f99c8-ca17-4259-9d20-77eeda6aee6e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:15.461327 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-db2f99c8-ca17-4259-9d20-77eeda6aee6e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:15.462644 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-db2f99c8-ca17-4259-9d20-77eeda6aee6e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:15.463113 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-db2f99c8-ca17-4259-9d20-77eeda6aee6e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:15.463540 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-db2f99c8-ca17-4259-9d20-77eeda6aee6e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:15.563885 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-db2f99c8-ca17-4259-9d20-77eeda6aee6e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:15.573956 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-db2f99c8-ca17-4259-9d20-77eeda6aee6e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1510 microversion: 2.1 time: 0.128766 Aug 19 16:40:15.574647 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 577/1153] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:15 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1510 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:15.745045 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-1599e721-0632-4d88-94d0-45900396d6c6 req-ddec0235-3ef7-4b36-be35-bb1ec420527b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f", "name": "network-vif-deleted", "tag": "494a4e31-f22f-4879-99a8-4f1e34a92a8e"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:40:15.759488 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-1599e721-0632-4d88-94d0-45900396d6c6 req-ddec0235-3ef7-4b36-be35-bb1ec420527b service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:15.760720 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-1599e721-0632-4d88-94d0-45900396d6c6 req-ddec0235-3ef7-4b36-be35-bb1ec420527b service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:15.763500 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-1599e721-0632-4d88-94d0-45900396d6c6 req-ddec0235-3ef7-4b36-be35-bb1ec420527b service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:15.786290 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-1599e721-0632-4d88-94d0-45900396d6c6 req-ddec0235-3ef7-4b36-be35-bb1ec420527b service nova] Creating event network-vif-deleted:494a4e31-f22f-4879-99a8-4f1e34a92a8e for instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f on hv-cinder-83124 Aug 19 16:40:15.792589 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-1599e721-0632-4d88-94d0-45900396d6c6 req-ddec0235-3ef7-4b36-be35-bb1ec420527b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052164 Aug 19 16:40:15.793733 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 577/1154] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:40:16.598266 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-bb09288c-f1bf-4c6a-af85-afec12b9ba7b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:16.599508 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-bb09288c-f1bf-4c6a-af85-afec12b9ba7b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:16.607576 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bb09288c-f1bf-4c6a-af85-afec12b9ba7b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:16.608122 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bb09288c-f1bf-4c6a-af85-afec12b9ba7b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:16.608557 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bb09288c-f1bf-4c6a-af85-afec12b9ba7b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:16.609374 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bb09288c-f1bf-4c6a-af85-afec12b9ba7b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:16.609734 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bb09288c-f1bf-4c6a-af85-afec12b9ba7b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:16.610475 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bb09288c-f1bf-4c6a-af85-afec12b9ba7b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:16.649207 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bb09288c-f1bf-4c6a-af85-afec12b9ba7b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:16.649941 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bb09288c-f1bf-4c6a-af85-afec12b9ba7b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:16.650381 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-bb09288c-f1bf-4c6a-af85-afec12b9ba7b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:16.650827 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.objects.instance [None req-bb09288c-f1bf-4c6a-af85-afec12b9ba7b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lazy-loading 'fault' on Instance uuid 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f {{(pid=127284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:40:16.693590 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-bb09288c-f1bf-4c6a-af85-afec12b9ba7b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:16.704485 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-bb09288c-f1bf-4c6a-af85-afec12b9ba7b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 200 len: 1230 microversion: 2.1 time: 0.110360 Aug 19 16:40:16.704485 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 578/1155] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:16 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 1230 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:40:17.728518 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0a2fd91f-d071-4826-b204-17f5dfcf5c57 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:17.729250 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-0a2fd91f-d071-4826-b204-17f5dfcf5c57 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:17.735452 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0a2fd91f-d071-4826-b204-17f5dfcf5c57 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:17.735923 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0a2fd91f-d071-4826-b204-17f5dfcf5c57 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:17.736541 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0a2fd91f-d071-4826-b204-17f5dfcf5c57 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:17.737254 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0a2fd91f-d071-4826-b204-17f5dfcf5c57 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:17.737699 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0a2fd91f-d071-4826-b204-17f5dfcf5c57 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:17.738307 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0a2fd91f-d071-4826-b204-17f5dfcf5c57 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:17.752682 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-0a2fd91f-d071-4826-b204-17f5dfcf5c57 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] HTTP exception thrown: Instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f could not be found. Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0a2fd91f-d071-4826-b204-17f5dfcf5c57 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Request method failure captured: Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f HTTP/1.1 Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7wwtaTPS4yhEMKX53xcC7hL62iip6pDRARiMrXKgIHc7CY848PNsJg1aSVdSjM5SD_z3fgBhz_mquV2-kYy_8uXoMWXhLsg9HRfkUwFsduJc4-aBd2DS7iN9bYmJzu-APLqRRI_lEHrhR-PflScv1JC-2oA2p5kwrfuzd0dYkyYGkc Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: 5181e8549b3a439c8921319d6957f670 Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-TestVolumeBootPattern-760970128 Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:40:17.754340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:40:17.756063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5181e8549b3a439c8921319d6957f670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5181e8549b3a439c8921319d6957f670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5181e8549b3a439c8921319d6957f670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5181e8549b3a439c8921319d6957f670"}]}] Aug 19 16:40:17.756063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-TestVolumeBootPattern-760970128 Aug 19 16:40:17.756063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: 5181e8549b3a439c8921319d6957f670 Aug 19 16:40:17.756063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-TestVolumeBootPattern-760970128 Aug 19 16:40:17.756063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-TestVolumeBootPattern-760970128-project Aug 19 16:40:17.756063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:40:17.756063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:40:17.756063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: f989b6fded53458b85b39789a32a39e4 Aug 19 16:40:17.756063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-TestVolumeBootPattern-760970128-project Aug 19 16:40:17.756063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:40:17.756063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f could not be found. Aug 19 16:40:17.756063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': '6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f'} Aug 19 16:40:17.757024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:40:17.757024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:17.757024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:40:17.757024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:40:17.757024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:40:17.757024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:40:17.757024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:40:17.757024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:40:17.757024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:40:17.757024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:40:17.757024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f could not be found. Aug 19 16:40:17.757024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:17.757024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:17.757024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:17.757024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:17.757024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:17.757024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:17.757024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:40:17.757024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:40:17.757024 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:40:17.758731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:40:17.758731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:40:17.758731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:40:17.758731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:40:17.758731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:40:17.758731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:40:17.758731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:40:17.758731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f could not be found. Aug 19 16:40:17.758731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:17.758731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:40:17.758731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:17.758731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:40:17.758731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:40:17.758731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:40:17.758731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:40:17.758731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:40:17.758731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f could not be found. Aug 19 16:40:17.758731 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:40:17.760119 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0a2fd91f-d071-4826-b204-17f5dfcf5c57 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Returning 404 to user: Instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:40:17.760119 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-0a2fd91f-d071-4826-b204-17f5dfcf5c57 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 404 len: 111 microversion: 2.1 time: 0.032471 Aug 19 16:40:17.760119 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 578/1156] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:17 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:40:17.896774 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f5088ab1-969a-411c-a0cb-b2c596e928e8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1992206098", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-160800237", "security_groups": [{"name": "tempest-secgroup-smoke-1980068120"}], "block_device_mapping_v2": [{"uuid": "f0fdf6a3-189b-4413-bfec-42e7f7d6588b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fe40a75b-64e5-47a8-bbbb-5d1e93f52142"}]}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:40:18.036558 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.network.neutron [None req-f5088ab1-969a-411c-a0cb-b2c596e928e8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] validate_networks() for [('fe40a75b-64e5-47a8-bbbb-5d1e93f52142', None, None, None, None, None)] {{(pid=127284) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:40:18.654162 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-f5088ab1-969a-411c-a0cb-b2c596e928e8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Flavor limits 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:40:18.654836 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-f5088ab1-969a-411c-a0cb-b2c596e928e8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Image limits 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:40:18.655414 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-f5088ab1-969a-411c-a0cb-b2c596e928e8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Flavor pref 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:40:18.655921 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-f5088ab1-969a-411c-a0cb-b2c596e928e8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Image pref 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:40:18.656560 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-f5088ab1-969a-411c-a0cb-b2c596e928e8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:40:18.666727 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f5088ab1-969a-411c-a0cb-b2c596e928e8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:18.667313 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f5088ab1-969a-411c-a0cb-b2c596e928e8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:18.667823 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f5088ab1-969a-411c-a0cb-b2c596e928e8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:18.668625 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f5088ab1-969a-411c-a0cb-b2c596e928e8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:18.669172 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f5088ab1-969a-411c-a0cb-b2c596e928e8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:18.669662 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f5088ab1-969a-411c-a0cb-b2c596e928e8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:18.687401 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-f5088ab1-969a-411c-a0cb-b2c596e928e8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Getting quotas for project 5181e8549b3a439c8921319d6957f670. Resources: {'ram', 'cores', 'instances'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:40:18.691869 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-f5088ab1-969a-411c-a0cb-b2c596e928e8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Getting quotas for user f989b6fded53458b85b39789a32a39e4 and project 5181e8549b3a439c8921319d6957f670. Resources: {'ram', 'cores', 'instances'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:40:18.755041 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f5088ab1-969a-411c-a0cb-b2c596e928e8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Going to run 1 instances... {{(pid=127284) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:40:18.757256 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f5088ab1-969a-411c-a0cb-b2c596e928e8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0fdf6a3-189b-4413-bfec-42e7f7d6588b',volume_size=None,volume_type=None)] {{(pid=127284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:40:18.908778 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f5088ab1-969a-411c-a0cb-b2c596e928e8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.025801 Aug 19 16:40:18.915689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 579/1157] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Aug 19 16:40:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 16:40:18.921627 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-7681cf42-9fe2-4411-a937-c94841e832d7 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:18.922342 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-7681cf42-9fe2-4411-a937-c94841e832d7 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:19.006405 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-7681cf42-9fe2-4411-a937-c94841e832d7 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:19.014546 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-7681cf42-9fe2-4411-a937-c94841e832d7 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1094 microversion: 2.1 time: 0.097206 Aug 19 16:40:19.016198 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 579/1158] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:18 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1094 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:40:20.037908 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-6a7a4ff8-fb14-47cd-b87d-cf890aa48585 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:20.039200 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-6a7a4ff8-fb14-47cd-b87d-cf890aa48585 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:20.050946 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6a7a4ff8-fb14-47cd-b87d-cf890aa48585 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:20.054618 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6a7a4ff8-fb14-47cd-b87d-cf890aa48585 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:20.056097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6a7a4ff8-fb14-47cd-b87d-cf890aa48585 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:20.059743 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6a7a4ff8-fb14-47cd-b87d-cf890aa48585 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:20.060316 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6a7a4ff8-fb14-47cd-b87d-cf890aa48585 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:20.061526 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6a7a4ff8-fb14-47cd-b87d-cf890aa48585 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:20.159701 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-6a7a4ff8-fb14-47cd-b87d-cf890aa48585 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:20.173145 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-6a7a4ff8-fb14-47cd-b87d-cf890aa48585 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1200 microversion: 2.1 time: 0.141000 Aug 19 16:40:20.173824 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 580/1159] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:20 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1200 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:40:21.197303 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b99bfdae-c889-48b6-9982-526ff016551d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:21.198597 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b99bfdae-c889-48b6-9982-526ff016551d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:21.221609 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b99bfdae-c889-48b6-9982-526ff016551d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:21.222109 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b99bfdae-c889-48b6-9982-526ff016551d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:21.252074 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b99bfdae-c889-48b6-9982-526ff016551d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:21.252987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b99bfdae-c889-48b6-9982-526ff016551d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:21.253479 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b99bfdae-c889-48b6-9982-526ff016551d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:21.253921 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b99bfdae-c889-48b6-9982-526ff016551d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:21.639833 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b99bfdae-c889-48b6-9982-526ff016551d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:21.652078 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b99bfdae-c889-48b6-9982-526ff016551d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1278 microversion: 2.1 time: 0.460210 Aug 19 16:40:21.666687 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 580/1160] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:21 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1278 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:21.801142 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-459f1241-d7fa-43c5-a18c-cd7f58fe4752 req-727b98d4-6a43-4e35-b918-8bebffa22b63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6d9c29e-2804-48bd-b739-42f35d5d3112", "tag": "f4a884d8-f8ff-4efe-b295-42f90763da1e"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:40:21.813061 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-459f1241-d7fa-43c5-a18c-cd7f58fe4752 req-727b98d4-6a43-4e35-b918-8bebffa22b63 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:21.813774 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-459f1241-d7fa-43c5-a18c-cd7f58fe4752 req-727b98d4-6a43-4e35-b918-8bebffa22b63 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:21.814329 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-459f1241-d7fa-43c5-a18c-cd7f58fe4752 req-727b98d4-6a43-4e35-b918-8bebffa22b63 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:21.828043 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-459f1241-d7fa-43c5-a18c-cd7f58fe4752 req-727b98d4-6a43-4e35-b918-8bebffa22b63 service nova] Creating event network-changed:f4a884d8-f8ff-4efe-b295-42f90763da1e for instance f6d9c29e-2804-48bd-b739-42f35d5d3112 on hv-cinder-83124 Aug 19 16:40:21.833610 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-459f1241-d7fa-43c5-a18c-cd7f58fe4752 req-727b98d4-6a43-4e35-b918-8bebffa22b63 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035854 Aug 19 16:40:21.835066 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 581/1161] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:40:22.673579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-719b53e2-66a2-4b23-80ff-9848680e8e77 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:22.674191 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-719b53e2-66a2-4b23-80ff-9848680e8e77 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:22.681220 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-719b53e2-66a2-4b23-80ff-9848680e8e77 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:22.681710 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-719b53e2-66a2-4b23-80ff-9848680e8e77 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:22.682148 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-719b53e2-66a2-4b23-80ff-9848680e8e77 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:22.682837 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-719b53e2-66a2-4b23-80ff-9848680e8e77 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:22.683291 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-719b53e2-66a2-4b23-80ff-9848680e8e77 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:22.683714 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-719b53e2-66a2-4b23-80ff-9848680e8e77 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:22.826385 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-719b53e2-66a2-4b23-80ff-9848680e8e77 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:22.834588 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-719b53e2-66a2-4b23-80ff-9848680e8e77 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1266 microversion: 2.1 time: 0.164401 Aug 19 16:40:22.835653 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 581/1162] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:22 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:23.856356 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-08060fd6-2fda-45bd-bff3-89913902f238 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:23.857098 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-08060fd6-2fda-45bd-bff3-89913902f238 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:23.863230 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-08060fd6-2fda-45bd-bff3-89913902f238 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:23.863704 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-08060fd6-2fda-45bd-bff3-89913902f238 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:23.864134 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-08060fd6-2fda-45bd-bff3-89913902f238 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:23.864899 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-08060fd6-2fda-45bd-bff3-89913902f238 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:23.865582 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-08060fd6-2fda-45bd-bff3-89913902f238 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:23.866217 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-08060fd6-2fda-45bd-bff3-89913902f238 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:24.002335 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-08060fd6-2fda-45bd-bff3-89913902f238 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:24.010725 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-08060fd6-2fda-45bd-bff3-89913902f238 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1266 microversion: 2.1 time: 0.159201 Aug 19 16:40:24.011282 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 582/1163] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:23 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:25.031008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0af54fed-cda9-4a04-ad45-713e0510fd53 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:25.031623 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-0af54fed-cda9-4a04-ad45-713e0510fd53 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:25.038049 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0af54fed-cda9-4a04-ad45-713e0510fd53 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:25.038531 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0af54fed-cda9-4a04-ad45-713e0510fd53 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:25.038979 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0af54fed-cda9-4a04-ad45-713e0510fd53 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:25.040503 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0af54fed-cda9-4a04-ad45-713e0510fd53 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:25.040980 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0af54fed-cda9-4a04-ad45-713e0510fd53 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:25.041410 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0af54fed-cda9-4a04-ad45-713e0510fd53 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:25.173127 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-0af54fed-cda9-4a04-ad45-713e0510fd53 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:25.181214 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-0af54fed-cda9-4a04-ad45-713e0510fd53 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1266 microversion: 2.1 time: 0.154223 Aug 19 16:40:25.181790 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 582/1164] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:25 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:26.202075 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-70347abc-f2ea-4cd6-9d1a-878c3ce2b4ee tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:26.202690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-70347abc-f2ea-4cd6-9d1a-878c3ce2b4ee tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:26.209330 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-70347abc-f2ea-4cd6-9d1a-878c3ce2b4ee tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:26.209918 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-70347abc-f2ea-4cd6-9d1a-878c3ce2b4ee tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:26.210566 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-70347abc-f2ea-4cd6-9d1a-878c3ce2b4ee tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:26.211552 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-70347abc-f2ea-4cd6-9d1a-878c3ce2b4ee tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:26.212005 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-70347abc-f2ea-4cd6-9d1a-878c3ce2b4ee tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:26.212386 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-70347abc-f2ea-4cd6-9d1a-878c3ce2b4ee tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:26.358347 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-70347abc-f2ea-4cd6-9d1a-878c3ce2b4ee tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:26.365975 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-70347abc-f2ea-4cd6-9d1a-878c3ce2b4ee tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1266 microversion: 2.1 time: 0.167722 Aug 19 16:40:26.366533 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 583/1165] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:26 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:27.388742 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2f858627-6806-4250-8a85-2732519b6583 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:27.389830 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2f858627-6806-4250-8a85-2732519b6583 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:27.396427 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2f858627-6806-4250-8a85-2732519b6583 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:27.396950 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2f858627-6806-4250-8a85-2732519b6583 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:27.397578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2f858627-6806-4250-8a85-2732519b6583 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:27.398647 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2f858627-6806-4250-8a85-2732519b6583 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:27.399271 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2f858627-6806-4250-8a85-2732519b6583 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:27.399706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2f858627-6806-4250-8a85-2732519b6583 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:27.540136 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2f858627-6806-4250-8a85-2732519b6583 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:27.548368 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2f858627-6806-4250-8a85-2732519b6583 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1266 microversion: 2.1 time: 0.165394 Aug 19 16:40:27.549044 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 583/1166] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:27 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:28.573166 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-0d2a1b2a-fbc6-4098-a5fc-6cd85b467917 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:28.573880 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-0d2a1b2a-fbc6-4098-a5fc-6cd85b467917 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:28.581136 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0d2a1b2a-fbc6-4098-a5fc-6cd85b467917 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:28.581825 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0d2a1b2a-fbc6-4098-a5fc-6cd85b467917 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:28.582444 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0d2a1b2a-fbc6-4098-a5fc-6cd85b467917 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:28.583134 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0d2a1b2a-fbc6-4098-a5fc-6cd85b467917 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:28.583761 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0d2a1b2a-fbc6-4098-a5fc-6cd85b467917 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:28.584185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0d2a1b2a-fbc6-4098-a5fc-6cd85b467917 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:28.678925 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=2 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:28.702970 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=6 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:28.759177 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-0d2a1b2a-fbc6-4098-a5fc-6cd85b467917 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:28.768671 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-0d2a1b2a-fbc6-4098-a5fc-6cd85b467917 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1266 microversion: 2.1 time: 0.201851 Aug 19 16:40:28.769447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 584/1167] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:28 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:29.791075 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-dc696aa8-5f45-4ef0-9db3-c9e6008809fc tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:29.791776 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-dc696aa8-5f45-4ef0-9db3-c9e6008809fc tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:29.794365 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=2 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:29.799957 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dc696aa8-5f45-4ef0-9db3-c9e6008809fc tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:29.800518 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dc696aa8-5f45-4ef0-9db3-c9e6008809fc tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:29.801065 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dc696aa8-5f45-4ef0-9db3-c9e6008809fc tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:29.801942 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dc696aa8-5f45-4ef0-9db3-c9e6008809fc tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:29.803762 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dc696aa8-5f45-4ef0-9db3-c9e6008809fc tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:29.803762 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dc696aa8-5f45-4ef0-9db3-c9e6008809fc tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:29.952178 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-dc696aa8-5f45-4ef0-9db3-c9e6008809fc tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:29.962702 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-dc696aa8-5f45-4ef0-9db3-c9e6008809fc tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1266 microversion: 2.1 time: 0.175828 Aug 19 16:40:29.963250 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 584/1168] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:29 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:30.983021 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b5ee72d2-82ea-404d-8277-56b6037b88aa tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:30.983627 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-b5ee72d2-82ea-404d-8277-56b6037b88aa tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:30.990049 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b5ee72d2-82ea-404d-8277-56b6037b88aa tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:30.990527 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b5ee72d2-82ea-404d-8277-56b6037b88aa tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:30.990963 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b5ee72d2-82ea-404d-8277-56b6037b88aa tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:30.991646 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b5ee72d2-82ea-404d-8277-56b6037b88aa tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:30.992909 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b5ee72d2-82ea-404d-8277-56b6037b88aa tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:30.993335 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b5ee72d2-82ea-404d-8277-56b6037b88aa tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:31.125288 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b5ee72d2-82ea-404d-8277-56b6037b88aa tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:31.133717 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b5ee72d2-82ea-404d-8277-56b6037b88aa tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1266 microversion: 2.1 time: 0.153885 Aug 19 16:40:31.134275 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 585/1169] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:30 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:32.155160 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-fa99f783-0073-4aa2-9013-37b7c98eca81 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:32.155900 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-fa99f783-0073-4aa2-9013-37b7c98eca81 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:32.162215 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fa99f783-0073-4aa2-9013-37b7c98eca81 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:32.162901 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fa99f783-0073-4aa2-9013-37b7c98eca81 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:32.163339 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fa99f783-0073-4aa2-9013-37b7c98eca81 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:32.164092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fa99f783-0073-4aa2-9013-37b7c98eca81 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:32.164532 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fa99f783-0073-4aa2-9013-37b7c98eca81 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:32.164970 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-fa99f783-0073-4aa2-9013-37b7c98eca81 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:32.385091 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-fa99f783-0073-4aa2-9013-37b7c98eca81 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:32.393641 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-fa99f783-0073-4aa2-9013-37b7c98eca81 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1266 microversion: 2.1 time: 0.242668 Aug 19 16:40:32.394310 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 585/1170] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:32 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:33.415521 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ddbf4678-76f0-43b6-bd98-9326acf91aa4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:33.416155 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ddbf4678-76f0-43b6-bd98-9326acf91aa4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:33.423040 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ddbf4678-76f0-43b6-bd98-9326acf91aa4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:33.423540 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ddbf4678-76f0-43b6-bd98-9326acf91aa4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:33.423985 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ddbf4678-76f0-43b6-bd98-9326acf91aa4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:33.424696 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ddbf4678-76f0-43b6-bd98-9326acf91aa4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:33.425183 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ddbf4678-76f0-43b6-bd98-9326acf91aa4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:33.425614 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ddbf4678-76f0-43b6-bd98-9326acf91aa4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:33.594163 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ddbf4678-76f0-43b6-bd98-9326acf91aa4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:33.604071 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ddbf4678-76f0-43b6-bd98-9326acf91aa4 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1266 microversion: 2.1 time: 0.193297 Aug 19 16:40:33.605124 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 586/1171] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:33 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:34.626318 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-54bec53a-43f0-4f40-ad97-0577e20b897e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:34.626928 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-54bec53a-43f0-4f40-ad97-0577e20b897e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:34.633663 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-54bec53a-43f0-4f40-ad97-0577e20b897e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:34.634143 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-54bec53a-43f0-4f40-ad97-0577e20b897e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:34.634573 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-54bec53a-43f0-4f40-ad97-0577e20b897e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:34.635257 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-54bec53a-43f0-4f40-ad97-0577e20b897e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:34.635705 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-54bec53a-43f0-4f40-ad97-0577e20b897e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:34.636150 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-54bec53a-43f0-4f40-ad97-0577e20b897e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:34.774896 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-54bec53a-43f0-4f40-ad97-0577e20b897e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:34.782880 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-54bec53a-43f0-4f40-ad97-0577e20b897e tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1266 microversion: 2.1 time: 0.160546 Aug 19 16:40:34.783477 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 586/1172] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:34 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:35.431371 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-536b4335-4f11-4847-87aa-60cdaf844752 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1306019808", "imageRef": "da4af7b7-e205-4511-ad99-3478c2523f74", "flavorRef": "452"}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:40:35.482492 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.network.neutron [None req-536b4335-4f11-4847-87aa-60cdaf844752 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] validate_networks() for None {{(pid=127284) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:40:35.760326 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-536b4335-4f11-4847-87aa-60cdaf844752 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Flavor limits 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:40:35.760987 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-536b4335-4f11-4847-87aa-60cdaf844752 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Image limits 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:40:35.761459 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-536b4335-4f11-4847-87aa-60cdaf844752 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Flavor pref 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:40:35.761861 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-536b4335-4f11-4847-87aa-60cdaf844752 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Image pref 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:40:35.762570 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-536b4335-4f11-4847-87aa-60cdaf844752 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:40:35.771726 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-536b4335-4f11-4847-87aa-60cdaf844752 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:35.772203 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-536b4335-4f11-4847-87aa-60cdaf844752 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:35.772631 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-536b4335-4f11-4847-87aa-60cdaf844752 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:35.773537 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-536b4335-4f11-4847-87aa-60cdaf844752 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:35.773992 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-536b4335-4f11-4847-87aa-60cdaf844752 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:35.774441 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-536b4335-4f11-4847-87aa-60cdaf844752 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:35.791759 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-536b4335-4f11-4847-87aa-60cdaf844752 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Getting quotas for project a120d2cba9884f148185606778440fff. Resources: {'ram', 'cores', 'instances'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:40:35.795704 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-536b4335-4f11-4847-87aa-60cdaf844752 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Getting quotas for user 5f0dd23f0f0b4891a9933cbe8a4861f3 and project a120d2cba9884f148185606778440fff. Resources: {'ram', 'cores', 'instances'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:40:35.803369 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-24930990-86d0-4aa7-96b3-2f899cc76d97 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:35.804116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-24930990-86d0-4aa7-96b3-2f899cc76d97 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:35.810714 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-24930990-86d0-4aa7-96b3-2f899cc76d97 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:35.811195 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-24930990-86d0-4aa7-96b3-2f899cc76d97 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:35.811624 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-24930990-86d0-4aa7-96b3-2f899cc76d97 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:35.812576 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-24930990-86d0-4aa7-96b3-2f899cc76d97 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:35.813057 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-24930990-86d0-4aa7-96b3-2f899cc76d97 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:35.813480 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-24930990-86d0-4aa7-96b3-2f899cc76d97 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:35.819563 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-536b4335-4f11-4847-87aa-60cdaf844752 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Going to run 1 instances... {{(pid=127284) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:40:35.822147 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-536b4335-4f11-4847-87aa-60cdaf844752 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='da4af7b7-e205-4511-ad99-3478c2523f74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:40:35.878344 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-536b4335-4f11-4847-87aa-60cdaf844752 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.450778 Aug 19 16:40:35.884984 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 587/1173] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Aug 19 16:40:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 16:40:35.890988 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7bafeffb-8c31-496a-b24d-abf4135cc3cf tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:35.891617 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-7bafeffb-8c31-496a-b24d-abf4135cc3cf tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:35.953350 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-24930990-86d0-4aa7-96b3-2f899cc76d97 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:35.955210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-7bafeffb-8c31-496a-b24d-abf4135cc3cf tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:35.962382 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-24930990-86d0-4aa7-96b3-2f899cc76d97 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1266 microversion: 2.1 time: 0.162744 Aug 19 16:40:35.962751 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7bafeffb-8c31-496a-b24d-abf4135cc3cf tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1215 microversion: 2.1 time: 0.075597 Aug 19 16:40:35.963546 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 588/1174] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:35 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:35.973443 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 587/1175] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:35 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:40:36.982880 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-3ca6b2b8-d5f1-43f4-a2d1-2097898c737b tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:36.983492 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-3ca6b2b8-d5f1-43f4-a2d1-2097898c737b tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:36.985608 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8925b5a7-8206-4777-b48c-b698eb986d3b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:36.986232 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8925b5a7-8206-4777-b48c-b698eb986d3b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:36.990030 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3ca6b2b8-d5f1-43f4-a2d1-2097898c737b tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:36.990511 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3ca6b2b8-d5f1-43f4-a2d1-2097898c737b tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:36.990967 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3ca6b2b8-d5f1-43f4-a2d1-2097898c737b tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:36.992801 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3ca6b2b8-d5f1-43f4-a2d1-2097898c737b tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:36.993331 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8925b5a7-8206-4777-b48c-b698eb986d3b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:36.993455 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3ca6b2b8-d5f1-43f4-a2d1-2097898c737b tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:36.993761 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3ca6b2b8-d5f1-43f4-a2d1-2097898c737b tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:36.993859 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8925b5a7-8206-4777-b48c-b698eb986d3b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:36.994238 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8925b5a7-8206-4777-b48c-b698eb986d3b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:36.994935 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8925b5a7-8206-4777-b48c-b698eb986d3b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:36.995451 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8925b5a7-8206-4777-b48c-b698eb986d3b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:36.995885 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8925b5a7-8206-4777-b48c-b698eb986d3b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:37.059278 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-3ca6b2b8-d5f1-43f4-a2d1-2097898c737b tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:37.067199 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-3ca6b2b8-d5f1-43f4-a2d1-2097898c737b tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1219 microversion: 2.1 time: 0.088309 Aug 19 16:40:37.067785 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 589/1176] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:36 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:37.139584 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-8925b5a7-8206-4777-b48c-b698eb986d3b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:37.147680 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8925b5a7-8206-4777-b48c-b698eb986d3b tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1266 microversion: 2.1 time: 0.166327 Aug 19 16:40:37.148254 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 588/1177] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:36 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:40:38.089440 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-cc448ddc-e7dc-42f5-944c-b638272a01d8 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:38.090671 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-cc448ddc-e7dc-42f5-944c-b638272a01d8 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:38.099254 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cc448ddc-e7dc-42f5-944c-b638272a01d8 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:38.100026 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cc448ddc-e7dc-42f5-944c-b638272a01d8 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:38.100529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cc448ddc-e7dc-42f5-944c-b638272a01d8 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:38.101672 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cc448ddc-e7dc-42f5-944c-b638272a01d8 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:38.102200 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cc448ddc-e7dc-42f5-944c-b638272a01d8 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:38.102725 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-cc448ddc-e7dc-42f5-944c-b638272a01d8 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:38.167964 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6bf7d1cf-f405-4b8c-ad5e-a3b033349866 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:38.170026 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6bf7d1cf-f405-4b8c-ad5e-a3b033349866 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:38.176006 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6bf7d1cf-f405-4b8c-ad5e-a3b033349866 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:38.176490 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6bf7d1cf-f405-4b8c-ad5e-a3b033349866 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:38.176947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6bf7d1cf-f405-4b8c-ad5e-a3b033349866 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:38.177688 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6bf7d1cf-f405-4b8c-ad5e-a3b033349866 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:38.178328 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6bf7d1cf-f405-4b8c-ad5e-a3b033349866 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:38.178751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6bf7d1cf-f405-4b8c-ad5e-a3b033349866 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:38.208264 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-cc448ddc-e7dc-42f5-944c-b638272a01d8 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:38.217594 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-cc448ddc-e7dc-42f5-944c-b638272a01d8 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1211 microversion: 2.1 time: 0.133509 Aug 19 16:40:38.218443 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 590/1178] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:38 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1211 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:38.237027 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-31817f84-a239-4fd7-90c8-1e646e0bb3b3 req-03c80c62-10ed-469a-83d7-16d6f5c6248f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d9c29e-2804-48bd-b739-42f35d5d3112", "name": "network-vif-plugged", "status": "completed", "tag": "f4a884d8-f8ff-4efe-b295-42f90763da1e"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:40:38.260173 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-31817f84-a239-4fd7-90c8-1e646e0bb3b3 req-03c80c62-10ed-469a-83d7-16d6f5c6248f service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:38.266383 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-31817f84-a239-4fd7-90c8-1e646e0bb3b3 req-03c80c62-10ed-469a-83d7-16d6f5c6248f service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:38.266841 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-31817f84-a239-4fd7-90c8-1e646e0bb3b3 req-03c80c62-10ed-469a-83d7-16d6f5c6248f service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:38.284465 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-31817f84-a239-4fd7-90c8-1e646e0bb3b3 req-03c80c62-10ed-469a-83d7-16d6f5c6248f service nova] Creating event network-vif-plugged:f4a884d8-f8ff-4efe-b295-42f90763da1e for instance f6d9c29e-2804-48bd-b739-42f35d5d3112 on hv-cinder-83124 Aug 19 16:40:38.290925 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-31817f84-a239-4fd7-90c8-1e646e0bb3b3 req-03c80c62-10ed-469a-83d7-16d6f5c6248f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070129 Aug 19 16:40:38.291636 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 591/1179] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:40:38.353573 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6bf7d1cf-f405-4b8c-ad5e-a3b033349866 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:38.361429 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6bf7d1cf-f405-4b8c-ad5e-a3b033349866 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1266 microversion: 2.1 time: 0.197806 Aug 19 16:40:38.361988 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 589/1180] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:38 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:40:39.243611 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-1e83825c-5aae-409c-b812-01bdb6708cbf tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:39.244923 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-1e83825c-5aae-409c-b812-01bdb6708cbf tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:39.251780 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1e83825c-5aae-409c-b812-01bdb6708cbf tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:39.252433 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1e83825c-5aae-409c-b812-01bdb6708cbf tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:39.253071 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1e83825c-5aae-409c-b812-01bdb6708cbf tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:39.254271 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1e83825c-5aae-409c-b812-01bdb6708cbf tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:39.255373 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1e83825c-5aae-409c-b812-01bdb6708cbf tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:39.256053 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-1e83825c-5aae-409c-b812-01bdb6708cbf tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:39.333501 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-1e83825c-5aae-409c-b812-01bdb6708cbf tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:39.341867 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-1e83825c-5aae-409c-b812-01bdb6708cbf tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1273 microversion: 2.1 time: 0.103147 Aug 19 16:40:39.342434 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 592/1181] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:39 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1273 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:39.382272 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a9c206fa-4aff-416f-a2de-29d73225ee4a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:39.382879 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a9c206fa-4aff-416f-a2de-29d73225ee4a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:39.389187 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a9c206fa-4aff-416f-a2de-29d73225ee4a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:39.389664 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a9c206fa-4aff-416f-a2de-29d73225ee4a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:39.390090 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a9c206fa-4aff-416f-a2de-29d73225ee4a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:39.390776 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a9c206fa-4aff-416f-a2de-29d73225ee4a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:39.391219 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a9c206fa-4aff-416f-a2de-29d73225ee4a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:39.391637 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a9c206fa-4aff-416f-a2de-29d73225ee4a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:39.527862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a9c206fa-4aff-416f-a2de-29d73225ee4a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:39.535707 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a9c206fa-4aff-416f-a2de-29d73225ee4a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1266 microversion: 2.1 time: 0.157412 Aug 19 16:40:39.536255 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 590/1182] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:39 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:40.363978 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-db5bce3f-e6b6-4880-8ecb-0a827a303b17 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:40.364602 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-db5bce3f-e6b6-4880-8ecb-0a827a303b17 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:40.372145 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-db5bce3f-e6b6-4880-8ecb-0a827a303b17 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:40.372682 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-db5bce3f-e6b6-4880-8ecb-0a827a303b17 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:40.373149 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-db5bce3f-e6b6-4880-8ecb-0a827a303b17 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:40.374066 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-db5bce3f-e6b6-4880-8ecb-0a827a303b17 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:40.374759 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-db5bce3f-e6b6-4880-8ecb-0a827a303b17 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:40.375885 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-db5bce3f-e6b6-4880-8ecb-0a827a303b17 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:40.553020 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-db5bce3f-e6b6-4880-8ecb-0a827a303b17 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:40.559831 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2ea23586-dc7c-4200-a20d-e9616d6138bd tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:40.560380 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2ea23586-dc7c-4200-a20d-e9616d6138bd tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:40.569983 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-db5bce3f-e6b6-4880-8ecb-0a827a303b17 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1315 microversion: 2.1 time: 0.210191 Aug 19 16:40:40.589212 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 593/1183] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:40 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:40.589621 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ea23586-dc7c-4200-a20d-e9616d6138bd tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:40.590118 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ea23586-dc7c-4200-a20d-e9616d6138bd tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:40.590677 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ea23586-dc7c-4200-a20d-e9616d6138bd tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:40.591394 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ea23586-dc7c-4200-a20d-e9616d6138bd tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:40.591983 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ea23586-dc7c-4200-a20d-e9616d6138bd tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:40.592540 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2ea23586-dc7c-4200-a20d-e9616d6138bd tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:40.832873 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2ea23586-dc7c-4200-a20d-e9616d6138bd tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:40.841465 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2ea23586-dc7c-4200-a20d-e9616d6138bd tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1454 microversion: 2.1 time: 0.285384 Aug 19 16:40:40.856701 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 591/1184] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:40 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1454 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:40:40.862418 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-9d6b6e69-9d6b-44ad-b030-635246104bf5 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:40.863033 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-9d6b6e69-9d6b-44ad-b030-635246104bf5 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:40.869868 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9d6b6e69-9d6b-44ad-b030-635246104bf5 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:40.870351 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9d6b6e69-9d6b-44ad-b030-635246104bf5 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:40.870789 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9d6b6e69-9d6b-44ad-b030-635246104bf5 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:40.871479 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9d6b6e69-9d6b-44ad-b030-635246104bf5 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:40.871937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9d6b6e69-9d6b-44ad-b030-635246104bf5 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:40.872359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9d6b6e69-9d6b-44ad-b030-635246104bf5 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:41.014959 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-9d6b6e69-9d6b-44ad-b030-635246104bf5 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:41.023659 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-9d6b6e69-9d6b-44ad-b030-635246104bf5 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1454 microversion: 2.1 time: 0.165154 Aug 19 16:40:41.024421 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 594/1185] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:40 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:41.207333 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-150681e9-a1ae-4817-bd6c-f1d7f3bb6635 req-b761d876-b562-42c0-b2d9-bd65ab7e8b13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcc43c44-f2d1-4c5a-8b92-6096640f018c", "tag": "6ba0a396-479e-4420-8aad-3067d0e269d9"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:40:41.217241 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-150681e9-a1ae-4817-bd6c-f1d7f3bb6635 req-b761d876-b562-42c0-b2d9-bd65ab7e8b13 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:41.217989 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-150681e9-a1ae-4817-bd6c-f1d7f3bb6635 req-b761d876-b562-42c0-b2d9-bd65ab7e8b13 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:41.218438 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-150681e9-a1ae-4817-bd6c-f1d7f3bb6635 req-b761d876-b562-42c0-b2d9-bd65ab7e8b13 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:41.222711 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:41.231810 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-150681e9-a1ae-4817-bd6c-f1d7f3bb6635 req-b761d876-b562-42c0-b2d9-bd65ab7e8b13 service nova] Creating event network-changed:6ba0a396-479e-4420-8aad-3067d0e269d9 for instance bcc43c44-f2d1-4c5a-8b92-6096640f018c on hv-cinder-83124 Aug 19 16:40:41.237037 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-150681e9-a1ae-4817-bd6c-f1d7f3bb6635 req-b761d876-b562-42c0-b2d9-bd65ab7e8b13 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034574 Aug 19 16:40:41.238032 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 592/1186] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:40:41.590476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c2873036-9611-4a16-8920-d52248d995d1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:41.591213 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-c2873036-9611-4a16-8920-d52248d995d1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:41.598157 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c2873036-9611-4a16-8920-d52248d995d1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:41.598641 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c2873036-9611-4a16-8920-d52248d995d1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:41.599076 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c2873036-9611-4a16-8920-d52248d995d1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:41.599775 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c2873036-9611-4a16-8920-d52248d995d1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:41.600222 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c2873036-9611-4a16-8920-d52248d995d1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:41.601384 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c2873036-9611-4a16-8920-d52248d995d1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:41.890783 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c2873036-9611-4a16-8920-d52248d995d1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:41.894318 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=100 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:41.899745 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c2873036-9611-4a16-8920-d52248d995d1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1315 microversion: 2.1 time: 0.313472 Aug 19 16:40:41.900393 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 595/1187] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:41 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:42.923162 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8b89c479-13bb-4f84-9928-5ed1de3185cd tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:42.923739 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8b89c479-13bb-4f84-9928-5ed1de3185cd tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:42.926229 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:42.932385 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8b89c479-13bb-4f84-9928-5ed1de3185cd tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:42.932981 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8b89c479-13bb-4f84-9928-5ed1de3185cd tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:42.933656 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8b89c479-13bb-4f84-9928-5ed1de3185cd tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:42.934429 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8b89c479-13bb-4f84-9928-5ed1de3185cd tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:42.934956 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8b89c479-13bb-4f84-9928-5ed1de3185cd tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:42.935476 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8b89c479-13bb-4f84-9928-5ed1de3185cd tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:42.962413 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-27125537-4105-41aa-8c90-3f621276aa46 req-e00ce173-1a8b-4ad3-8f10-0cc14bbac5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6d9c29e-2804-48bd-b739-42f35d5d3112", "tag": "f4a884d8-f8ff-4efe-b295-42f90763da1e"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:40:42.977446 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:42.982917 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-27125537-4105-41aa-8c90-3f621276aa46 req-e00ce173-1a8b-4ad3-8f10-0cc14bbac5d2 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:42.983605 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-27125537-4105-41aa-8c90-3f621276aa46 req-e00ce173-1a8b-4ad3-8f10-0cc14bbac5d2 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:42.984286 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-27125537-4105-41aa-8c90-3f621276aa46 req-e00ce173-1a8b-4ad3-8f10-0cc14bbac5d2 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:42.998756 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-27125537-4105-41aa-8c90-3f621276aa46 req-e00ce173-1a8b-4ad3-8f10-0cc14bbac5d2 service nova] Creating event network-changed:f4a884d8-f8ff-4efe-b295-42f90763da1e for instance f6d9c29e-2804-48bd-b739-42f35d5d3112 on hv-cinder-83124 Aug 19 16:40:43.003953 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-27125537-4105-41aa-8c90-3f621276aa46 req-e00ce173-1a8b-4ad3-8f10-0cc14bbac5d2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045465 Aug 19 16:40:43.004543 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 596/1188] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:40:43.079095 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-8b89c479-13bb-4f84-9928-5ed1de3185cd tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:43.087577 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8b89c479-13bb-4f84-9928-5ed1de3185cd tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1315 microversion: 2.1 time: 0.169577 Aug 19 16:40:43.088236 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 593/1189] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:42 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:44.110818 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-9583de6b-d515-40da-b005-0f7f10e1dfee tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:44.111514 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-9583de6b-d515-40da-b005-0f7f10e1dfee tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:44.119050 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9583de6b-d515-40da-b005-0f7f10e1dfee tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:44.119535 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9583de6b-d515-40da-b005-0f7f10e1dfee tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:44.119978 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9583de6b-d515-40da-b005-0f7f10e1dfee tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:44.120671 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9583de6b-d515-40da-b005-0f7f10e1dfee tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:44.121149 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9583de6b-d515-40da-b005-0f7f10e1dfee tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:44.121572 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9583de6b-d515-40da-b005-0f7f10e1dfee tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:44.340848 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-9583de6b-d515-40da-b005-0f7f10e1dfee tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:44.349933 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-9583de6b-d515-40da-b005-0f7f10e1dfee tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1315 microversion: 2.1 time: 0.244932 Aug 19 16:40:44.351458 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 597/1190] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:44 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:45.372472 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-dd9cc24e-b5fc-452f-b68e-c8b1ee6479d1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:45.373117 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-dd9cc24e-b5fc-452f-b68e-c8b1ee6479d1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:45.379691 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dd9cc24e-b5fc-452f-b68e-c8b1ee6479d1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:45.380175 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dd9cc24e-b5fc-452f-b68e-c8b1ee6479d1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:45.380613 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dd9cc24e-b5fc-452f-b68e-c8b1ee6479d1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:45.381335 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dd9cc24e-b5fc-452f-b68e-c8b1ee6479d1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:45.382430 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dd9cc24e-b5fc-452f-b68e-c8b1ee6479d1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:45.382970 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-dd9cc24e-b5fc-452f-b68e-c8b1ee6479d1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:45.512542 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-dd9cc24e-b5fc-452f-b68e-c8b1ee6479d1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:45.520086 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-dd9cc24e-b5fc-452f-b68e-c8b1ee6479d1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1315 microversion: 2.1 time: 0.151579 Aug 19 16:40:45.520646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 594/1191] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:45 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:46.540689 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e1a2a546-7f19-4f43-9107-fb1bda0a81f1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:46.541336 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-e1a2a546-7f19-4f43-9107-fb1bda0a81f1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:46.543729 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=2 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:46.544424 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=8 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:40:46.550216 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e1a2a546-7f19-4f43-9107-fb1bda0a81f1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:46.550696 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e1a2a546-7f19-4f43-9107-fb1bda0a81f1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:46.551130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e1a2a546-7f19-4f43-9107-fb1bda0a81f1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:46.551835 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e1a2a546-7f19-4f43-9107-fb1bda0a81f1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:46.552273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e1a2a546-7f19-4f43-9107-fb1bda0a81f1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:46.552699 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e1a2a546-7f19-4f43-9107-fb1bda0a81f1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:46.693097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e1a2a546-7f19-4f43-9107-fb1bda0a81f1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:46.701352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e1a2a546-7f19-4f43-9107-fb1bda0a81f1 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1315 microversion: 2.1 time: 0.164640 Aug 19 16:40:46.702093 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 598/1192] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:46 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:47.721734 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ba3e7d22-b50e-4ad7-a8a2-90250fcaf4fe tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:47.722346 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ba3e7d22-b50e-4ad7-a8a2-90250fcaf4fe tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:47.728969 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ba3e7d22-b50e-4ad7-a8a2-90250fcaf4fe tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:47.729455 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ba3e7d22-b50e-4ad7-a8a2-90250fcaf4fe tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:47.729892 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ba3e7d22-b50e-4ad7-a8a2-90250fcaf4fe tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:47.730612 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ba3e7d22-b50e-4ad7-a8a2-90250fcaf4fe tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:47.731069 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ba3e7d22-b50e-4ad7-a8a2-90250fcaf4fe tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:47.731492 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ba3e7d22-b50e-4ad7-a8a2-90250fcaf4fe tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:47.859513 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ba3e7d22-b50e-4ad7-a8a2-90250fcaf4fe tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:47.867450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ba3e7d22-b50e-4ad7-a8a2-90250fcaf4fe tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1315 microversion: 2.1 time: 0.149603 Aug 19 16:40:47.868012 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 595/1193] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:47 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:48.888388 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b61f8c04-43d3-4d19-bdfd-66e5d907e2e4 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:48.889028 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-b61f8c04-43d3-4d19-bdfd-66e5d907e2e4 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:48.896034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b61f8c04-43d3-4d19-bdfd-66e5d907e2e4 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:48.896521 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b61f8c04-43d3-4d19-bdfd-66e5d907e2e4 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:48.897645 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b61f8c04-43d3-4d19-bdfd-66e5d907e2e4 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:48.898524 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b61f8c04-43d3-4d19-bdfd-66e5d907e2e4 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:48.898975 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b61f8c04-43d3-4d19-bdfd-66e5d907e2e4 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:48.899399 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b61f8c04-43d3-4d19-bdfd-66e5d907e2e4 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:49.061765 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b61f8c04-43d3-4d19-bdfd-66e5d907e2e4 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:49.069560 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b61f8c04-43d3-4d19-bdfd-66e5d907e2e4 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1315 microversion: 2.1 time: 0.185413 Aug 19 16:40:49.070122 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 599/1194] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:48 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:50.091025 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-65181ae2-7781-470f-9d97-e2d7db8ddee6 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:50.091652 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-65181ae2-7781-470f-9d97-e2d7db8ddee6 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:50.097750 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-65181ae2-7781-470f-9d97-e2d7db8ddee6 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:50.098240 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-65181ae2-7781-470f-9d97-e2d7db8ddee6 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:50.098665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-65181ae2-7781-470f-9d97-e2d7db8ddee6 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:50.099441 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-65181ae2-7781-470f-9d97-e2d7db8ddee6 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:50.099890 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-65181ae2-7781-470f-9d97-e2d7db8ddee6 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:50.100309 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-65181ae2-7781-470f-9d97-e2d7db8ddee6 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:50.253091 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-65181ae2-7781-470f-9d97-e2d7db8ddee6 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:50.255523 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-eef4ab99-f9e7-4d15-b497-c02659d414d6 req-8dceac70-e5d7-4bad-bdbe-e5c69c9504da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcc43c44-f2d1-4c5a-8b92-6096640f018c", "name": "network-vif-plugged", "status": "completed", "tag": "6ba0a396-479e-4420-8aad-3067d0e269d9"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:40:50.261491 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-65181ae2-7781-470f-9d97-e2d7db8ddee6 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1315 microversion: 2.1 time: 0.174362 Aug 19 16:40:50.262514 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 596/1195] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:50 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:50.265835 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-eef4ab99-f9e7-4d15-b497-c02659d414d6 req-8dceac70-e5d7-4bad-bdbe-e5c69c9504da service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:50.266533 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-eef4ab99-f9e7-4d15-b497-c02659d414d6 req-8dceac70-e5d7-4bad-bdbe-e5c69c9504da service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:50.267214 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-eef4ab99-f9e7-4d15-b497-c02659d414d6 req-8dceac70-e5d7-4bad-bdbe-e5c69c9504da service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:50.280291 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-eef4ab99-f9e7-4d15-b497-c02659d414d6 req-8dceac70-e5d7-4bad-bdbe-e5c69c9504da service nova] Creating event network-vif-plugged:6ba0a396-479e-4420-8aad-3067d0e269d9 for instance bcc43c44-f2d1-4c5a-8b92-6096640f018c on hv-cinder-83124 Aug 19 16:40:50.288523 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-eef4ab99-f9e7-4d15-b497-c02659d414d6 req-8dceac70-e5d7-4bad-bdbe-e5c69c9504da service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036530 Aug 19 16:40:50.289666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 600/1196] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:40:51.283402 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8ef70624-9a02-48d7-9144-cf2d6d235075 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:51.284016 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8ef70624-9a02-48d7-9144-cf2d6d235075 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:51.290942 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8ef70624-9a02-48d7-9144-cf2d6d235075 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:51.291427 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8ef70624-9a02-48d7-9144-cf2d6d235075 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:51.291865 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8ef70624-9a02-48d7-9144-cf2d6d235075 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:51.292560 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8ef70624-9a02-48d7-9144-cf2d6d235075 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:51.293040 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8ef70624-9a02-48d7-9144-cf2d6d235075 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:51.293467 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-8ef70624-9a02-48d7-9144-cf2d6d235075 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:51.427049 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-8ef70624-9a02-48d7-9144-cf2d6d235075 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:51.437265 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8ef70624-9a02-48d7-9144-cf2d6d235075 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1315 microversion: 2.1 time: 0.157771 Aug 19 16:40:51.438237 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 597/1197] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:51 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:52.459513 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d5245c49-705f-4b8a-a187-b463ab897834 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:52.461157 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d5245c49-705f-4b8a-a187-b463ab897834 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:52.467391 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d5245c49-705f-4b8a-a187-b463ab897834 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:52.467865 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d5245c49-705f-4b8a-a187-b463ab897834 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:52.468295 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d5245c49-705f-4b8a-a187-b463ab897834 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:52.469008 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d5245c49-705f-4b8a-a187-b463ab897834 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:52.469448 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d5245c49-705f-4b8a-a187-b463ab897834 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:52.469884 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d5245c49-705f-4b8a-a187-b463ab897834 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:52.597662 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d5245c49-705f-4b8a-a187-b463ab897834 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:52.605152 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d5245c49-705f-4b8a-a187-b463ab897834 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1315 microversion: 2.1 time: 0.150449 Aug 19 16:40:52.605705 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 601/1198] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:52 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:40:53.626196 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-1487e3eb-ab11-4da8-8a74-d6f2207af9fa tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:53.626825 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-1487e3eb-ab11-4da8-8a74-d6f2207af9fa tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:53.633163 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1487e3eb-ab11-4da8-8a74-d6f2207af9fa tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:53.633641 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1487e3eb-ab11-4da8-8a74-d6f2207af9fa tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:53.634068 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1487e3eb-ab11-4da8-8a74-d6f2207af9fa tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:53.634747 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1487e3eb-ab11-4da8-8a74-d6f2207af9fa tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:53.635197 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1487e3eb-ab11-4da8-8a74-d6f2207af9fa tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:53.635616 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-1487e3eb-ab11-4da8-8a74-d6f2207af9fa tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:53.761944 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-1487e3eb-ab11-4da8-8a74-d6f2207af9fa tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:53.769480 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-1487e3eb-ab11-4da8-8a74-d6f2207af9fa tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1315 microversion: 2.1 time: 0.147076 Aug 19 16:40:53.770038 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 598/1199] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:53 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:54.791563 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-b7376dc2-0fab-4c2f-97fc-4a7ee1438b1c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:54.792108 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-b7376dc2-0fab-4c2f-97fc-4a7ee1438b1c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:54.798487 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b7376dc2-0fab-4c2f-97fc-4a7ee1438b1c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:54.798961 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b7376dc2-0fab-4c2f-97fc-4a7ee1438b1c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:54.799395 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b7376dc2-0fab-4c2f-97fc-4a7ee1438b1c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:54.800084 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b7376dc2-0fab-4c2f-97fc-4a7ee1438b1c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:54.800533 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b7376dc2-0fab-4c2f-97fc-4a7ee1438b1c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:54.800981 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-b7376dc2-0fab-4c2f-97fc-4a7ee1438b1c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:54.940589 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-b7376dc2-0fab-4c2f-97fc-4a7ee1438b1c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:54.949264 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-b7376dc2-0fab-4c2f-97fc-4a7ee1438b1c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1315 microversion: 2.1 time: 0.162410 Aug 19 16:40:54.949912 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 602/1200] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:54 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:55.970079 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f722f39d-344a-4058-883f-210958358050 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:55.970693 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f722f39d-344a-4058-883f-210958358050 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:55.980772 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f722f39d-344a-4058-883f-210958358050 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:55.981267 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f722f39d-344a-4058-883f-210958358050 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:55.981700 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f722f39d-344a-4058-883f-210958358050 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:55.982402 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f722f39d-344a-4058-883f-210958358050 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:55.982851 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f722f39d-344a-4058-883f-210958358050 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:55.983274 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f722f39d-344a-4058-883f-210958358050 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:56.114372 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f722f39d-344a-4058-883f-210958358050 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:56.122181 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f722f39d-344a-4058-883f-210958358050 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1465 microversion: 2.1 time: 0.155914 Aug 19 16:40:56.122744 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 599/1201] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:55 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1465 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:56.169047 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-6c71eeee-2ad9-4325-98e5-7f73719d637c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:56.169549 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-6c71eeee-2ad9-4325-98e5-7f73719d637c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:56.175605 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6c71eeee-2ad9-4325-98e5-7f73719d637c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:56.176077 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6c71eeee-2ad9-4325-98e5-7f73719d637c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:56.176504 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6c71eeee-2ad9-4325-98e5-7f73719d637c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:56.177221 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6c71eeee-2ad9-4325-98e5-7f73719d637c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:56.177668 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6c71eeee-2ad9-4325-98e5-7f73719d637c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:56.178082 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6c71eeee-2ad9-4325-98e5-7f73719d637c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:56.203317 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-6c71eeee-2ad9-4325-98e5-7f73719d637c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Going to try to terminate instance {{(pid=127284) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:40:56.288105 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-6c71eeee-2ad9-4325-98e5-7f73719d637c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "DELETE /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 204 len: 0 microversion: 2.1 time: 0.122943 Aug 19 16:40:56.290496 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 603/1202] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:40:56 2022] DELETE /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:40:56.298823 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f63b3871-f8e5-4851-ad34-e18399bfc980 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:56.299795 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f63b3871-f8e5-4851-ad34-e18399bfc980 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:56.305654 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f63b3871-f8e5-4851-ad34-e18399bfc980 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:56.306130 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f63b3871-f8e5-4851-ad34-e18399bfc980 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:56.306560 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f63b3871-f8e5-4851-ad34-e18399bfc980 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:56.307240 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f63b3871-f8e5-4851-ad34-e18399bfc980 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:56.307687 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f63b3871-f8e5-4851-ad34-e18399bfc980 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:56.308105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f63b3871-f8e5-4851-ad34-e18399bfc980 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:56.461796 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f63b3871-f8e5-4851-ad34-e18399bfc980 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:56.472494 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f63b3871-f8e5-4851-ad34-e18399bfc980 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1471 microversion: 2.1 time: 0.175340 Aug 19 16:40:56.472494 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 600/1203] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:56 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:40:57.499065 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-4a5aafdd-307a-40fb-b680-3bd9fb4a544c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:57.500292 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-4a5aafdd-307a-40fb-b680-3bd9fb4a544c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:57.508185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4a5aafdd-307a-40fb-b680-3bd9fb4a544c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:57.508706 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4a5aafdd-307a-40fb-b680-3bd9fb4a544c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:57.509225 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4a5aafdd-307a-40fb-b680-3bd9fb4a544c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:57.509916 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4a5aafdd-307a-40fb-b680-3bd9fb4a544c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:57.510363 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4a5aafdd-307a-40fb-b680-3bd9fb4a544c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:57.510781 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4a5aafdd-307a-40fb-b680-3bd9fb4a544c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:57.649927 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-4a5aafdd-307a-40fb-b680-3bd9fb4a544c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:57.658572 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-4a5aafdd-307a-40fb-b680-3bd9fb4a544c tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1471 microversion: 2.1 time: 0.164052 Aug 19 16:40:57.659129 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 604/1204] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:57 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:58.680051 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-98f3723d-fa84-4717-8f39-a2458e3e6965 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:58.680653 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-98f3723d-fa84-4717-8f39-a2458e3e6965 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:58.687299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-98f3723d-fa84-4717-8f39-a2458e3e6965 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:58.687807 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-98f3723d-fa84-4717-8f39-a2458e3e6965 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:58.688240 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-98f3723d-fa84-4717-8f39-a2458e3e6965 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:58.688959 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-98f3723d-fa84-4717-8f39-a2458e3e6965 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:58.689412 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-98f3723d-fa84-4717-8f39-a2458e3e6965 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:58.689835 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-98f3723d-fa84-4717-8f39-a2458e3e6965 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:58.815983 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-98f3723d-fa84-4717-8f39-a2458e3e6965 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:58.824256 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-98f3723d-fa84-4717-8f39-a2458e3e6965 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1471 microversion: 2.1 time: 0.148632 Aug 19 16:40:58.824831 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 601/1205] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:58 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:40:59.845346 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d39901e3-059c-478d-8f69-9ff9a473c787 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:40:59.845939 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d39901e3-059c-478d-8f69-9ff9a473c787 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:40:59.852478 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d39901e3-059c-478d-8f69-9ff9a473c787 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:59.852996 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d39901e3-059c-478d-8f69-9ff9a473c787 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:59.853426 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d39901e3-059c-478d-8f69-9ff9a473c787 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:59.854103 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d39901e3-059c-478d-8f69-9ff9a473c787 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:40:59.854548 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d39901e3-059c-478d-8f69-9ff9a473c787 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:40:59.854966 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d39901e3-059c-478d-8f69-9ff9a473c787 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:40:59.991762 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d39901e3-059c-478d-8f69-9ff9a473c787 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:40:59.999527 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d39901e3-059c-478d-8f69-9ff9a473c787 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1471 microversion: 2.1 time: 0.158001 Aug 19 16:41:00.000109 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 605/1206] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:40:59 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:41:00.922475 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-6c310448-35c8-4a03-8115-e0bd3daa81c1 req-4c5e6ba1-9f98-4db6-84fe-42764b17b10d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcc43c44-f2d1-4c5a-8b92-6096640f018c", "name": "network-vif-deleted", "tag": "6ba0a396-479e-4420-8aad-3067d0e269d9"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:41:00.934679 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-6c310448-35c8-4a03-8115-e0bd3daa81c1 req-4c5e6ba1-9f98-4db6-84fe-42764b17b10d service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:00.935266 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-6c310448-35c8-4a03-8115-e0bd3daa81c1 req-4c5e6ba1-9f98-4db6-84fe-42764b17b10d service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:00.936012 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-6c310448-35c8-4a03-8115-e0bd3daa81c1 req-4c5e6ba1-9f98-4db6-84fe-42764b17b10d service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:00.951339 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-6c310448-35c8-4a03-8115-e0bd3daa81c1 req-4c5e6ba1-9f98-4db6-84fe-42764b17b10d service nova] Creating event network-vif-deleted:6ba0a396-479e-4420-8aad-3067d0e269d9 for instance bcc43c44-f2d1-4c5a-8b92-6096640f018c on hv-cinder-83124 Aug 19 16:41:00.957366 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-6c310448-35c8-4a03-8115-e0bd3daa81c1 req-4c5e6ba1-9f98-4db6-84fe-42764b17b10d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038825 Aug 19 16:41:00.961488 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 602/1207] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:41:01.021612 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d5ebdb64-1312-4412-9350-e7f6affe170f tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:41:01.022880 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d5ebdb64-1312-4412-9350-e7f6affe170f tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:41:01.030233 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d5ebdb64-1312-4412-9350-e7f6affe170f tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:01.030719 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d5ebdb64-1312-4412-9350-e7f6affe170f tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:01.031153 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d5ebdb64-1312-4412-9350-e7f6affe170f tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:01.031853 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d5ebdb64-1312-4412-9350-e7f6affe170f tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:01.032297 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d5ebdb64-1312-4412-9350-e7f6affe170f tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:01.032712 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d5ebdb64-1312-4412-9350-e7f6affe170f tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:01.128644 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d5ebdb64-1312-4412-9350-e7f6affe170f tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0dd23f0f0b4891a9933cbe8a4861f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a120d2cba9884f148185606778440fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:41:01.143231 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d5ebdb64-1312-4412-9350-e7f6affe170f tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 200 len: 1300 microversion: 2.1 time: 0.125464 Aug 19 16:41:01.144067 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 606/1208] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:41:01 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 1300 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:41:02.167406 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3f4e3006-9d09-48e5-bd94-b39109297159 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:41:02.168144 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-3f4e3006-9d09-48e5-bd94-b39109297159 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] [instance: bcc43c44-f2d1-4c5a-8b92-6096640f018c] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:41:02.174308 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3f4e3006-9d09-48e5-bd94-b39109297159 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:02.174790 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3f4e3006-9d09-48e5-bd94-b39109297159 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:02.175238 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3f4e3006-9d09-48e5-bd94-b39109297159 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:02.175928 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3f4e3006-9d09-48e5-bd94-b39109297159 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:02.176384 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3f4e3006-9d09-48e5-bd94-b39109297159 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:02.176832 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3f4e3006-9d09-48e5-bd94-b39109297159 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:02.190840 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-3f4e3006-9d09-48e5-bd94-b39109297159 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] HTTP exception thrown: Instance bcc43c44-f2d1-4c5a-8b92-6096640f018c could not be found. Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3f4e3006-9d09-48e5-bd94-b39109297159 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Request method failure captured: Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c HTTP/1.1 Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_70BYYAT5muYvE_qLEYOb67z5BJdbswvYY7kjyVtjakd5YnCjAgGCx-H545BBvT1NGuyD1m9gwkUlzfVnmxpaIH4t9f5ASeJFLgkmjrBPZgcb-JcrtYW8_OrLasTh0C8blva3gNck-SH5eFid_aOPCP6XsHjesEfrdQdnz_GgnMAe6w Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: a120d2cba9884f148185606778440fff Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-VolumesNegativeTest-630621011 Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:41:02.192558 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:41:02.194827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a120d2cba9884f148185606778440fff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a120d2cba9884f148185606778440fff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a120d2cba9884f148185606778440fff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a120d2cba9884f148185606778440fff"}]}] Aug 19 16:41:02.194827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-VolumesNegativeTest-630621011 Aug 19 16:41:02.194827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: a120d2cba9884f148185606778440fff Aug 19 16:41:02.194827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-VolumesNegativeTest-630621011 Aug 19 16:41:02.194827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-VolumesNegativeTest-630621011-project Aug 19 16:41:02.194827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:41:02.194827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:41:02.194827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: 5f0dd23f0f0b4891a9933cbe8a4861f3 Aug 19 16:41:02.194827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-VolumesNegativeTest-630621011-project Aug 19 16:41:02.194827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:41:02.194827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance bcc43c44-f2d1-4c5a-8b92-6096640f018c could not be found. Aug 19 16:41:02.194827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': 'bcc43c44-f2d1-4c5a-8b92-6096640f018c'} Aug 19 16:41:02.195862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:41:02.195862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:41:02.195862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:41:02.195862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:41:02.195862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:41:02.195862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:41:02.195862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:41:02.195862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:41:02.195862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:41:02.195862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:41:02.195862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcc43c44-f2d1-4c5a-8b92-6096640f018c could not be found. Aug 19 16:41:02.195862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:41:02.195862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:41:02.195862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:41:02.195862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:41:02.195862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:41:02.195862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:41:02.195862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:41:02.195862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:41:02.195862 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:41:02.197447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:41:02.197447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:41:02.197447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:41:02.197447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:41:02.197447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:41:02.197447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:41:02.197447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:41:02.197447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcc43c44-f2d1-4c5a-8b92-6096640f018c could not be found. Aug 19 16:41:02.197447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:41:02.197447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:41:02.197447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:41:02.197447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:41:02.197447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:41:02.197447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:41:02.197447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:41:02.197447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:41:02.197447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcc43c44-f2d1-4c5a-8b92-6096640f018c could not be found. Aug 19 16:41:02.197447 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:41:02.198826 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3f4e3006-9d09-48e5-bd94-b39109297159 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] Returning 404 to user: Instance bcc43c44-f2d1-4c5a-8b92-6096640f018c could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:41:02.198826 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3f4e3006-9d09-48e5-bd94-b39109297159 tempest-VolumesNegativeTest-630621011 tempest-VolumesNegativeTest-630621011-project] 10.222.0.55 "GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c" status: 404 len: 111 microversion: 2.1 time: 0.031538 Aug 19 16:41:02.198826 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 603/1209] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:41:02 2022] GET /compute/v2.1/servers/bcc43c44-f2d1-4c5a-8b92-6096640f018c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:41:18.329863 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:41:18.331188 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:41:18.514947 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-7a5623a4-3d73-4980-85ba-31b88d0dd2a1 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Action: 'create', calling method: .version_select at 0x7fb01e4858b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1622513670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvND7veeKryRqb8Q87muBJObyTmGo/oxw6Qp4xM1My3kfSApqdOduhTVQvIQQTO+hRAFjxuuErJAiy743bzuHqkpiyYbYXWlfYypCAVlZgJy4wID5uv72Bd8PcVkVaC9A=="}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:41:18.530879 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-7a5623a4-3d73-4980-85ba-31b88d0dd2a1 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Getting quotas for project 363667c09d4e481da5767f1043d57e76. Resources: {'key_pairs'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:41:18.534967 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-7a5623a4-3d73-4980-85ba-31b88d0dd2a1 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Getting quotas for user 886a581760e547b6a15856da84ef3859 and project 363667c09d4e481da5767f1043d57e76. Resources: {'key_pairs'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:41:18.548266 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7a5623a4-3d73-4980-85ba-31b88d0dd2a1 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [f6c8bbcd-6020-4d7c-a026-95256fe7a520] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 19 16:41:19.556064 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO oslo.messaging._drivers.impl_rabbit [None req-7a5623a4-3d73-4980-85ba-31b88d0dd2a1 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [f6c8bbcd-6020-4d7c-a026-95256fe7a520] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 51990. Aug 19 16:41:19.574385 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-7a5623a4-3d73-4980-85ba-31b88d0dd2a1 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.249723 Aug 19 16:41:19.575014 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 607/1210] 10.222.0.55 () {60 vars in 1159 bytes} [Fri Aug 19 16:41:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:41:41.199579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a25f9666-087f-4c36-80d7-fffba39ddb04 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-909387381", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1622513670", "security_groups": [{"name": "tempest-secgroup-smoke-2129047720"}], "networks": [{"uuid": "7547103e-d702-4c89-bfbb-5d0f4876237b"}], "block_device_mapping_v2": [{"uuid": "0d997029-f6d6-4754-9ab0-6a33e20b3694", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:41:41.209594 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=21 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:41:41.210351 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=58 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:41:41.315032 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.network.neutron [None req-a25f9666-087f-4c36-80d7-fffba39ddb04 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] validate_networks() for [('7547103e-d702-4c89-bfbb-5d0f4876237b', None, None, None, None, None)] {{(pid=127285) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:41:41.691827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-a25f9666-087f-4c36-80d7-fffba39ddb04 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Flavor limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:41:41.692259 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-a25f9666-087f-4c36-80d7-fffba39ddb04 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Image limits 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:41:41.692734 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-a25f9666-087f-4c36-80d7-fffba39ddb04 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Flavor pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:41:41.693182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-a25f9666-087f-4c36-80d7-fffba39ddb04 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Image pref 0:0:0 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:41:41.693598 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.virt.hardware [None req-a25f9666-087f-4c36-80d7-fffba39ddb04 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:41:41.702820 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a25f9666-087f-4c36-80d7-fffba39ddb04 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:41.703375 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a25f9666-087f-4c36-80d7-fffba39ddb04 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:41.703884 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a25f9666-087f-4c36-80d7-fffba39ddb04 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:41.704702 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a25f9666-087f-4c36-80d7-fffba39ddb04 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:41.705266 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a25f9666-087f-4c36-80d7-fffba39ddb04 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:41.705766 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a25f9666-087f-4c36-80d7-fffba39ddb04 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:41.722917 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-a25f9666-087f-4c36-80d7-fffba39ddb04 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Getting quotas for project 363667c09d4e481da5767f1043d57e76. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:41:41.726963 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.quota [None req-a25f9666-087f-4c36-80d7-fffba39ddb04 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Getting quotas for user 886a581760e547b6a15856da84ef3859 and project 363667c09d4e481da5767f1043d57e76. Resources: {'ram', 'cores', 'instances'} {{(pid=127285) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:41:41.784770 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a25f9666-087f-4c36-80d7-fffba39ddb04 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Going to run 1 instances... {{(pid=127285) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:41:41.787359 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a25f9666-087f-4c36-80d7-fffba39ddb04 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0d997029-f6d6-4754-9ab0-6a33e20b3694',volume_size=None,volume_type=None)] {{(pid=127285) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:41:41.923780 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a25f9666-087f-4c36-80d7-fffba39ddb04 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.728083 Aug 19 16:41:41.924625 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 604/1211] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Aug 19 16:41:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 16:41:41.934139 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=4 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:41:41.936224 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:41:41.940815 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-bf275f37-5398-4f8c-82e6-9be65dbac9f5 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:41:41.941975 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-bf275f37-5398-4f8c-82e6-9be65dbac9f5 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:41:42.012416 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-bf275f37-5398-4f8c-82e6-9be65dbac9f5 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:41:42.021022 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-bf275f37-5398-4f8c-82e6-9be65dbac9f5 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1088 microversion: 2.1 time: 0.089297 Aug 19 16:41:42.021798 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 608/1212] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:41:41 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1088 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:41:43.042381 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c61248ac-3efb-4b8b-9845-974e7732392a tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:41:43.043753 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c61248ac-3efb-4b8b-9845-974e7732392a tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:41:43.053044 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c61248ac-3efb-4b8b-9845-974e7732392a tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:43.054103 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c61248ac-3efb-4b8b-9845-974e7732392a tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:43.054771 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c61248ac-3efb-4b8b-9845-974e7732392a tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:43.056795 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c61248ac-3efb-4b8b-9845-974e7732392a tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:43.058403 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c61248ac-3efb-4b8b-9845-974e7732392a tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:43.059066 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c61248ac-3efb-4b8b-9845-974e7732392a tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:43.130783 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c61248ac-3efb-4b8b-9845-974e7732392a tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:41:43.141126 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c61248ac-3efb-4b8b-9845-974e7732392a tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1204 microversion: 2.1 time: 0.102857 Aug 19 16:41:43.142108 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 605/1213] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:41:43 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1204 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:41:44.163572 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f9ce3ef7-1053-4b22-a4fd-55ad543b4fc9 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:41:44.164323 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f9ce3ef7-1053-4b22-a4fd-55ad543b4fc9 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:41:44.172005 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f9ce3ef7-1053-4b22-a4fd-55ad543b4fc9 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:44.172537 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f9ce3ef7-1053-4b22-a4fd-55ad543b4fc9 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:44.173241 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f9ce3ef7-1053-4b22-a4fd-55ad543b4fc9 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:44.174179 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f9ce3ef7-1053-4b22-a4fd-55ad543b4fc9 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:44.175136 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f9ce3ef7-1053-4b22-a4fd-55ad543b4fc9 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:44.175571 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f9ce3ef7-1053-4b22-a4fd-55ad543b4fc9 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:44.401690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f9ce3ef7-1053-4b22-a4fd-55ad543b4fc9 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:41:44.409833 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f9ce3ef7-1053-4b22-a4fd-55ad543b4fc9 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1272 microversion: 2.1 time: 0.250128 Aug 19 16:41:44.410555 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 609/1214] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:41:44 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1272 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:41:44.464116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-519338d4-d763-4ca9-9bf9-fdd55ffd8d42 req-03d0faa3-346a-4081-a637-37b2218f5717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aa33ae3-4967-490a-9f6c-81e8d4281a0f", "tag": "a73aa2cc-c181-4f88-a281-4452334ab294"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:41:44.475874 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-519338d4-d763-4ca9-9bf9-fdd55ffd8d42 req-03d0faa3-346a-4081-a637-37b2218f5717 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:44.476369 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-519338d4-d763-4ca9-9bf9-fdd55ffd8d42 req-03d0faa3-346a-4081-a637-37b2218f5717 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:44.476831 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-519338d4-d763-4ca9-9bf9-fdd55ffd8d42 req-03d0faa3-346a-4081-a637-37b2218f5717 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:44.488782 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-519338d4-d763-4ca9-9bf9-fdd55ffd8d42 req-03d0faa3-346a-4081-a637-37b2218f5717 service nova] Creating event network-changed:a73aa2cc-c181-4f88-a281-4452334ab294 for instance 8aa33ae3-4967-490a-9f6c-81e8d4281a0f on hv-cinder-83124 Aug 19 16:41:44.493866 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-519338d4-d763-4ca9-9bf9-fdd55ffd8d42 req-03d0faa3-346a-4081-a637-37b2218f5717 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042322 Aug 19 16:41:44.495026 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 606/1215] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:41:45.431074 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-009e0a47-6493-414e-9879-c5aa4a6f39a2 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:41:45.431683 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-009e0a47-6493-414e-9879-c5aa4a6f39a2 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:41:45.438649 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-009e0a47-6493-414e-9879-c5aa4a6f39a2 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:45.439133 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-009e0a47-6493-414e-9879-c5aa4a6f39a2 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:45.439591 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-009e0a47-6493-414e-9879-c5aa4a6f39a2 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:45.440286 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-009e0a47-6493-414e-9879-c5aa4a6f39a2 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:45.440947 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-009e0a47-6493-414e-9879-c5aa4a6f39a2 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:45.441385 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-009e0a47-6493-414e-9879-c5aa4a6f39a2 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:45.646862 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-009e0a47-6493-414e-9879-c5aa4a6f39a2 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:41:45.654887 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-009e0a47-6493-414e-9879-c5aa4a6f39a2 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1260 microversion: 2.1 time: 0.227669 Aug 19 16:41:45.655653 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 610/1216] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:41:45 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:41:46.677066 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-619f63ea-b0ba-48d5-ad50-ae81f8fa2f5c tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:41:46.677761 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-619f63ea-b0ba-48d5-ad50-ae81f8fa2f5c tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:41:46.684528 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-619f63ea-b0ba-48d5-ad50-ae81f8fa2f5c tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:46.685027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-619f63ea-b0ba-48d5-ad50-ae81f8fa2f5c tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:46.685457 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-619f63ea-b0ba-48d5-ad50-ae81f8fa2f5c tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:46.686134 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-619f63ea-b0ba-48d5-ad50-ae81f8fa2f5c tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:46.686575 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-619f63ea-b0ba-48d5-ad50-ae81f8fa2f5c tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:46.687285 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-619f63ea-b0ba-48d5-ad50-ae81f8fa2f5c tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:46.826737 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-619f63ea-b0ba-48d5-ad50-ae81f8fa2f5c tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:41:46.834737 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-619f63ea-b0ba-48d5-ad50-ae81f8fa2f5c tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1260 microversion: 2.1 time: 0.162974 Aug 19 16:41:46.835290 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 607/1217] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:41:46 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:41:47.855123 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-5907e906-1747-4d0a-98e7-0d4a12aa35b4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:41:47.855729 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-5907e906-1747-4d0a-98e7-0d4a12aa35b4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:41:47.862244 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5907e906-1747-4d0a-98e7-0d4a12aa35b4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:47.862749 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5907e906-1747-4d0a-98e7-0d4a12aa35b4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:47.863190 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5907e906-1747-4d0a-98e7-0d4a12aa35b4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:47.863868 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5907e906-1747-4d0a-98e7-0d4a12aa35b4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:47.864320 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5907e906-1747-4d0a-98e7-0d4a12aa35b4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:47.864738 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5907e906-1747-4d0a-98e7-0d4a12aa35b4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:47.992093 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-5907e906-1747-4d0a-98e7-0d4a12aa35b4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:41:47.999690 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-5907e906-1747-4d0a-98e7-0d4a12aa35b4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1260 microversion: 2.1 time: 0.148458 Aug 19 16:41:48.000243 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 611/1218] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:41:47 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:41:49.021049 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-b47b95d7-dbc1-4af7-8393-2fd877c201d8 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:41:49.021661 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-b47b95d7-dbc1-4af7-8393-2fd877c201d8 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:41:49.028381 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b47b95d7-dbc1-4af7-8393-2fd877c201d8 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:49.029059 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b47b95d7-dbc1-4af7-8393-2fd877c201d8 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:49.029552 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b47b95d7-dbc1-4af7-8393-2fd877c201d8 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:49.030468 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b47b95d7-dbc1-4af7-8393-2fd877c201d8 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:49.030923 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b47b95d7-dbc1-4af7-8393-2fd877c201d8 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:49.031357 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-b47b95d7-dbc1-4af7-8393-2fd877c201d8 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:49.319788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-b47b95d7-dbc1-4af7-8393-2fd877c201d8 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:41:49.328079 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-b47b95d7-dbc1-4af7-8393-2fd877c201d8 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1260 microversion: 2.1 time: 0.311245 Aug 19 16:41:49.328634 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 608/1219] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:41:49 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1260 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:41:50.348974 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-9d3376bb-ce3c-4663-94e6-5f25a5564f27 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:41:50.349643 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-9d3376bb-ce3c-4663-94e6-5f25a5564f27 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:41:50.356016 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9d3376bb-ce3c-4663-94e6-5f25a5564f27 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:50.356490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9d3376bb-ce3c-4663-94e6-5f25a5564f27 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:50.356958 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9d3376bb-ce3c-4663-94e6-5f25a5564f27 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:50.357637 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9d3376bb-ce3c-4663-94e6-5f25a5564f27 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:50.358084 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9d3376bb-ce3c-4663-94e6-5f25a5564f27 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:50.358500 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9d3376bb-ce3c-4663-94e6-5f25a5564f27 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:50.761506 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-9d3376bb-ce3c-4663-94e6-5f25a5564f27 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:41:50.769820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-9d3376bb-ce3c-4663-94e6-5f25a5564f27 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1260 microversion: 2.1 time: 0.425060 Aug 19 16:41:50.770391 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 612/1220] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:41:50 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1260 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:41:51.790981 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-ce0d3633-f10b-4fd3-8743-4f1d91b503b6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:41:51.791588 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-ce0d3633-f10b-4fd3-8743-4f1d91b503b6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:41:51.794051 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=2 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:41:51.794701 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=6 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:41:51.800395 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce0d3633-f10b-4fd3-8743-4f1d91b503b6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:51.800873 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce0d3633-f10b-4fd3-8743-4f1d91b503b6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:51.801303 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce0d3633-f10b-4fd3-8743-4f1d91b503b6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:51.801985 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce0d3633-f10b-4fd3-8743-4f1d91b503b6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:51.802431 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce0d3633-f10b-4fd3-8743-4f1d91b503b6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:51.802853 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-ce0d3633-f10b-4fd3-8743-4f1d91b503b6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:51.933716 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-ce0d3633-f10b-4fd3-8743-4f1d91b503b6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:41:51.941512 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-ce0d3633-f10b-4fd3-8743-4f1d91b503b6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1260 microversion: 2.1 time: 0.154391 Aug 19 16:41:51.942071 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 609/1221] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:41:51 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:41:52.961052 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-fcde37e3-d6c7-40f9-9170-410f2e9a3f70 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:41:52.961669 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-fcde37e3-d6c7-40f9-9170-410f2e9a3f70 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:41:52.963993 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=2 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:41:52.969374 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fcde37e3-d6c7-40f9-9170-410f2e9a3f70 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:52.969857 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fcde37e3-d6c7-40f9-9170-410f2e9a3f70 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:52.970333 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fcde37e3-d6c7-40f9-9170-410f2e9a3f70 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:52.971023 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fcde37e3-d6c7-40f9-9170-410f2e9a3f70 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:52.972012 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fcde37e3-d6c7-40f9-9170-410f2e9a3f70 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:52.972437 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fcde37e3-d6c7-40f9-9170-410f2e9a3f70 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:53.156321 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-fcde37e3-d6c7-40f9-9170-410f2e9a3f70 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:41:53.164617 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-fcde37e3-d6c7-40f9-9170-410f2e9a3f70 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1260 microversion: 2.1 time: 0.207435 Aug 19 16:41:53.165148 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 613/1222] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:41:52 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:41:54.185921 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-31f20d22-e562-48f7-8dd0-51327620c2a0 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:41:54.186529 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-31f20d22-e562-48f7-8dd0-51327620c2a0 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:41:54.193709 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-31f20d22-e562-48f7-8dd0-51327620c2a0 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:54.194188 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-31f20d22-e562-48f7-8dd0-51327620c2a0 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:54.194618 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-31f20d22-e562-48f7-8dd0-51327620c2a0 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:54.195299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-31f20d22-e562-48f7-8dd0-51327620c2a0 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:54.195751 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-31f20d22-e562-48f7-8dd0-51327620c2a0 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:54.196164 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-31f20d22-e562-48f7-8dd0-51327620c2a0 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:54.335962 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-31f20d22-e562-48f7-8dd0-51327620c2a0 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:41:54.343606 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-31f20d22-e562-48f7-8dd0-51327620c2a0 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1260 microversion: 2.1 time: 0.161728 Aug 19 16:41:54.344182 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 610/1223] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:41:54 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:41:55.365047 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-fb86aa85-fbf0-4b99-b6c6-2765c4b927cb tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:41:55.365586 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-fb86aa85-fbf0-4b99-b6c6-2765c4b927cb tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:41:55.371908 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fb86aa85-fbf0-4b99-b6c6-2765c4b927cb tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:55.372384 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fb86aa85-fbf0-4b99-b6c6-2765c4b927cb tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:55.372838 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fb86aa85-fbf0-4b99-b6c6-2765c4b927cb tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:55.373524 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fb86aa85-fbf0-4b99-b6c6-2765c4b927cb tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:55.373973 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fb86aa85-fbf0-4b99-b6c6-2765c4b927cb tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:55.374397 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fb86aa85-fbf0-4b99-b6c6-2765c4b927cb tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:55.511039 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-fb86aa85-fbf0-4b99-b6c6-2765c4b927cb tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:41:55.519403 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-fb86aa85-fbf0-4b99-b6c6-2765c4b927cb tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1260 microversion: 2.1 time: 0.158313 Aug 19 16:41:55.519895 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 614/1224] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:41:55 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:41:56.540616 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e476bd4c-d0d0-4d08-b3a0-958fc1830cc4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:41:56.541229 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e476bd4c-d0d0-4d08-b3a0-958fc1830cc4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:41:56.547578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e476bd4c-d0d0-4d08-b3a0-958fc1830cc4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:56.548055 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e476bd4c-d0d0-4d08-b3a0-958fc1830cc4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:56.548482 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e476bd4c-d0d0-4d08-b3a0-958fc1830cc4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:56.549181 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e476bd4c-d0d0-4d08-b3a0-958fc1830cc4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:56.549692 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e476bd4c-d0d0-4d08-b3a0-958fc1830cc4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:56.550110 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e476bd4c-d0d0-4d08-b3a0-958fc1830cc4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:56.586228 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-902e4764-1769-41ed-9050-4d39aa13cde3 req-e0caf31d-75c4-4330-9796-95cca52eb283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aa33ae3-4967-490a-9f6c-81e8d4281a0f", "name": "network-vif-plugged", "status": "completed", "tag": "a73aa2cc-c181-4f88-a281-4452334ab294"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:41:56.598130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-902e4764-1769-41ed-9050-4d39aa13cde3 req-e0caf31d-75c4-4330-9796-95cca52eb283 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:56.598760 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-902e4764-1769-41ed-9050-4d39aa13cde3 req-e0caf31d-75c4-4330-9796-95cca52eb283 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:56.599308 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-902e4764-1769-41ed-9050-4d39aa13cde3 req-e0caf31d-75c4-4330-9796-95cca52eb283 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:56.612487 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-902e4764-1769-41ed-9050-4d39aa13cde3 req-e0caf31d-75c4-4330-9796-95cca52eb283 service nova] Creating event network-vif-plugged:a73aa2cc-c181-4f88-a281-4452334ab294 for instance 8aa33ae3-4967-490a-9f6c-81e8d4281a0f on hv-cinder-83124 Aug 19 16:41:56.618062 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-902e4764-1769-41ed-9050-4d39aa13cde3 req-e0caf31d-75c4-4330-9796-95cca52eb283 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035450 Aug 19 16:41:56.618743 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 615/1225] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:41:56.689003 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e476bd4c-d0d0-4d08-b3a0-958fc1830cc4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:41:56.702896 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e476bd4c-d0d0-4d08-b3a0-958fc1830cc4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1260 microversion: 2.1 time: 0.165910 Aug 19 16:41:56.703452 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 611/1226] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:41:56 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:41:57.725055 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-d84b4b29-145e-4489-87a0-2278d6271fa9 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:41:57.725802 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-d84b4b29-145e-4489-87a0-2278d6271fa9 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:41:57.731868 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d84b4b29-145e-4489-87a0-2278d6271fa9 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:57.732340 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d84b4b29-145e-4489-87a0-2278d6271fa9 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:57.732802 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d84b4b29-145e-4489-87a0-2278d6271fa9 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:57.733603 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d84b4b29-145e-4489-87a0-2278d6271fa9 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:57.734052 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d84b4b29-145e-4489-87a0-2278d6271fa9 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:57.734471 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-d84b4b29-145e-4489-87a0-2278d6271fa9 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:57.869025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-d84b4b29-145e-4489-87a0-2278d6271fa9 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:41:57.877270 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-d84b4b29-145e-4489-87a0-2278d6271fa9 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1260 microversion: 2.1 time: 0.157471 Aug 19 16:41:57.877917 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 616/1227] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:41:57 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:41:58.898403 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-294195b2-0a48-44bf-b574-36e2888caeb2 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:41:58.899020 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-294195b2-0a48-44bf-b574-36e2888caeb2 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:41:58.905508 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-294195b2-0a48-44bf-b574-36e2888caeb2 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:58.905994 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-294195b2-0a48-44bf-b574-36e2888caeb2 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:58.906450 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-294195b2-0a48-44bf-b574-36e2888caeb2 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:58.907128 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-294195b2-0a48-44bf-b574-36e2888caeb2 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:58.907584 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-294195b2-0a48-44bf-b574-36e2888caeb2 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:58.908020 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-294195b2-0a48-44bf-b574-36e2888caeb2 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:59.042505 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-294195b2-0a48-44bf-b574-36e2888caeb2 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:41:59.050164 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-294195b2-0a48-44bf-b574-36e2888caeb2 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1443 microversion: 2.1 time: 0.155602 Aug 19 16:41:59.050897 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 612/1228] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:41:58 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:41:59.070618 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-39b78506-c2cb-4d07-ae89-18efded77be6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:41:59.071218 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-39b78506-c2cb-4d07-ae89-18efded77be6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:41:59.077571 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39b78506-c2cb-4d07-ae89-18efded77be6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:59.078046 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39b78506-c2cb-4d07-ae89-18efded77be6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:59.078476 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39b78506-c2cb-4d07-ae89-18efded77be6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:59.079150 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39b78506-c2cb-4d07-ae89-18efded77be6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:41:59.079593 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39b78506-c2cb-4d07-ae89-18efded77be6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:41:59.080008 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-39b78506-c2cb-4d07-ae89-18efded77be6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:41:59.218621 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-39b78506-c2cb-4d07-ae89-18efded77be6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:41:59.226782 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-39b78506-c2cb-4d07-ae89-18efded77be6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1443 microversion: 2.1 time: 0.159947 Aug 19 16:41:59.227366 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 617/1229] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:41:59 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1443 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:42:00.978830 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-4d53edb3-51d9-495a-9975-7f09f9ee77f7 req-2f9a6636-4151-4aac-b7a6-4a7ad197cedc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aa33ae3-4967-490a-9f6c-81e8d4281a0f", "tag": "a73aa2cc-c181-4f88-a281-4452334ab294"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:42:00.989035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-4d53edb3-51d9-495a-9975-7f09f9ee77f7 req-2f9a6636-4151-4aac-b7a6-4a7ad197cedc service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:00.989587 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-4d53edb3-51d9-495a-9975-7f09f9ee77f7 req-2f9a6636-4151-4aac-b7a6-4a7ad197cedc service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:00.990103 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-4d53edb3-51d9-495a-9975-7f09f9ee77f7 req-2f9a6636-4151-4aac-b7a6-4a7ad197cedc service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:01.001344 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-4d53edb3-51d9-495a-9975-7f09f9ee77f7 req-2f9a6636-4151-4aac-b7a6-4a7ad197cedc service nova] Creating event network-changed:a73aa2cc-c181-4f88-a281-4452334ab294 for instance 8aa33ae3-4967-490a-9f6c-81e8d4281a0f on hv-cinder-83124 Aug 19 16:42:01.007330 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-4d53edb3-51d9-495a-9975-7f09f9ee77f7 req-2f9a6636-4151-4aac-b7a6-4a7ad197cedc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032138 Aug 19 16:42:01.008344 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 613/1230] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:42:02.298210 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 16:42:02.299409 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Fri Aug 19 16:42:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 16:42:44.533302 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-072b706b-1d65-4aa1-89b3-fd615a04f973 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-216596085", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-160800237", "security_groups": [{"name": "tempest-secgroup-smoke-1980068120"}], "block_device_mapping_v2": [{"uuid": "acdd83ad-688b-4497-a66f-eee0a1f080d9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fe40a75b-64e5-47a8-bbbb-5d1e93f52142"}]}} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:42:44.542790 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=22 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:44.543450 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=50 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:44.645198 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.network.neutron [None req-072b706b-1d65-4aa1-89b3-fd615a04f973 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] validate_networks() for [('fe40a75b-64e5-47a8-bbbb-5d1e93f52142', None, None, None, None, None)] {{(pid=127284) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 19 16:42:45.014344 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-072b706b-1d65-4aa1-89b3-fd615a04f973 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Flavor limits 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 16:42:45.014759 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-072b706b-1d65-4aa1-89b3-fd615a04f973 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Image limits 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 16:42:45.015224 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-072b706b-1d65-4aa1-89b3-fd615a04f973 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Flavor pref 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 16:42:45.015626 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-072b706b-1d65-4aa1-89b3-fd615a04f973 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Image pref 0:0:0 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 16:42:45.016034 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.virt.hardware [None req-072b706b-1d65-4aa1-89b3-fd615a04f973 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 16:42:45.025439 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-072b706b-1d65-4aa1-89b3-fd615a04f973 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:45.025913 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-072b706b-1d65-4aa1-89b3-fd615a04f973 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:45.026337 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-072b706b-1d65-4aa1-89b3-fd615a04f973 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:45.027054 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-072b706b-1d65-4aa1-89b3-fd615a04f973 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:45.027499 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-072b706b-1d65-4aa1-89b3-fd615a04f973 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:45.027916 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-072b706b-1d65-4aa1-89b3-fd615a04f973 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:45.045317 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-072b706b-1d65-4aa1-89b3-fd615a04f973 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Getting quotas for project 5181e8549b3a439c8921319d6957f670. Resources: {'ram', 'cores', 'instances'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 19 16:42:45.049290 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.quota [None req-072b706b-1d65-4aa1-89b3-fd615a04f973 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Getting quotas for user f989b6fded53458b85b39789a32a39e4 and project 5181e8549b3a439c8921319d6957f670. Resources: {'ram', 'cores', 'instances'} {{(pid=127284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 19 16:42:45.105123 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-072b706b-1d65-4aa1-89b3-fd615a04f973 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Going to run 1 instances... {{(pid=127284) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 19 16:42:45.108160 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-072b706b-1d65-4aa1-89b3-fd615a04f973 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='acdd83ad-688b-4497-a66f-eee0a1f080d9',volume_size=None,volume_type=None)] {{(pid=127284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 19 16:42:45.230510 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR oslo.messaging._drivers.impl_rabbit [None req-072b706b-1d65-4aa1-89b3-fd615a04f973 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [b4a927ef-f8be-4b79-93da-22560c19b531] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 19 16:42:46.238338 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO oslo.messaging._drivers.impl_rabbit [None req-072b706b-1d65-4aa1-89b3-fd615a04f973 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [b4a927ef-f8be-4b79-93da-22560c19b531] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 52736. Aug 19 16:42:46.242708 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-072b706b-1d65-4aa1-89b3-fd615a04f973 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.713433 Aug 19 16:42:46.243351 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 618/1231] 10.222.0.55 () {60 vars in 1147 bytes} [Fri Aug 19 16:42:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 16:42:46.252320 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:46.253213 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=48 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:46.258303 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-8ffb824f-9dec-4d2d-a682-28d29341b15a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:42:46.259029 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-8ffb824f-9dec-4d2d-a682-28d29341b15a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:42:46.315478 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-8ffb824f-9dec-4d2d-a682-28d29341b15a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:42:46.322284 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-8ffb824f-9dec-4d2d-a682-28d29341b15a tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a" status: 200 len: 1093 microversion: 2.1 time: 0.071770 Aug 19 16:42:46.322845 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 614/1232] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:42:46 2022] GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:42:47.343664 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-98b71c26-bbcd-4bd4-a8cf-f790153902fc tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:42:47.344278 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-98b71c26-bbcd-4bd4-a8cf-f790153902fc tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:42:47.350891 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-98b71c26-bbcd-4bd4-a8cf-f790153902fc tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:47.351990 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-98b71c26-bbcd-4bd4-a8cf-f790153902fc tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:47.352447 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-98b71c26-bbcd-4bd4-a8cf-f790153902fc tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:47.353340 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-98b71c26-bbcd-4bd4-a8cf-f790153902fc tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:47.353816 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-98b71c26-bbcd-4bd4-a8cf-f790153902fc tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:47.354266 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-98b71c26-bbcd-4bd4-a8cf-f790153902fc tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:47.437640 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-98b71c26-bbcd-4bd4-a8cf-f790153902fc tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:42:47.446760 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-98b71c26-bbcd-4bd4-a8cf-f790153902fc tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a" status: 200 len: 1199 microversion: 2.1 time: 0.107693 Aug 19 16:42:47.447943 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 619/1233] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:42:47 2022] GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a => generated 1199 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:42:48.467746 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-074a8d75-34bc-4e06-a89f-df08f8eac687 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:42:48.468365 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-074a8d75-34bc-4e06-a89f-df08f8eac687 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:42:48.475063 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-074a8d75-34bc-4e06-a89f-df08f8eac687 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:48.475547 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-074a8d75-34bc-4e06-a89f-df08f8eac687 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:48.475982 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-074a8d75-34bc-4e06-a89f-df08f8eac687 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:48.476674 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-074a8d75-34bc-4e06-a89f-df08f8eac687 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:48.477153 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-074a8d75-34bc-4e06-a89f-df08f8eac687 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:48.477578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-074a8d75-34bc-4e06-a89f-df08f8eac687 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:48.610013 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-074a8d75-34bc-4e06-a89f-df08f8eac687 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:42:48.617753 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-074a8d75-34bc-4e06-a89f-df08f8eac687 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a" status: 200 len: 1265 microversion: 2.1 time: 0.154118 Aug 19 16:42:48.618305 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 615/1234] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:42:48 2022] GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:42:49.038452 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-8a214dba-5ade-400a-b165-154ca5a900e6 req-25e0d3e0-3788-4fd8-b51f-4fe013a2a96d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "080f26e7-95bb-467f-8a36-b1b1b425fa6a", "tag": "8ebcfe06-c492-4177-9ecb-14663d731a3b"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:42:49.048176 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-8a214dba-5ade-400a-b165-154ca5a900e6 req-25e0d3e0-3788-4fd8-b51f-4fe013a2a96d service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:49.048794 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-8a214dba-5ade-400a-b165-154ca5a900e6 req-25e0d3e0-3788-4fd8-b51f-4fe013a2a96d service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:49.049225 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-8a214dba-5ade-400a-b165-154ca5a900e6 req-25e0d3e0-3788-4fd8-b51f-4fe013a2a96d service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:49.063539 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-8a214dba-5ade-400a-b165-154ca5a900e6 req-25e0d3e0-3788-4fd8-b51f-4fe013a2a96d service nova] Creating event network-changed:8ebcfe06-c492-4177-9ecb-14663d731a3b for instance 080f26e7-95bb-467f-8a36-b1b1b425fa6a on hv-cinder-83124 Aug 19 16:42:49.068459 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-8a214dba-5ade-400a-b165-154ca5a900e6 req-25e0d3e0-3788-4fd8-b51f-4fe013a2a96d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158006 Aug 19 16:42:49.069101 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 620/1235] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:42:49.638125 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-bd934607-c779-44c3-b218-72b7bf44aaf3 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:42:49.639415 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-bd934607-c779-44c3-b218-72b7bf44aaf3 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:42:49.645799 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bd934607-c779-44c3-b218-72b7bf44aaf3 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:49.646275 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bd934607-c779-44c3-b218-72b7bf44aaf3 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:49.646700 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bd934607-c779-44c3-b218-72b7bf44aaf3 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:49.647420 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bd934607-c779-44c3-b218-72b7bf44aaf3 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:49.647868 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bd934607-c779-44c3-b218-72b7bf44aaf3 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:49.648285 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-bd934607-c779-44c3-b218-72b7bf44aaf3 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:49.777595 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-bd934607-c779-44c3-b218-72b7bf44aaf3 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:42:49.785372 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-bd934607-c779-44c3-b218-72b7bf44aaf3 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a" status: 200 len: 1265 microversion: 2.1 time: 0.151139 Aug 19 16:42:49.785926 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 616/1236] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:42:49 2022] GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:42:50.807227 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-3bc353db-2d8c-49ad-849b-38693cae2125 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:42:50.807930 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-3bc353db-2d8c-49ad-849b-38693cae2125 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:42:50.815323 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3bc353db-2d8c-49ad-849b-38693cae2125 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:50.815805 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3bc353db-2d8c-49ad-849b-38693cae2125 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:50.816243 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3bc353db-2d8c-49ad-849b-38693cae2125 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:50.816964 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3bc353db-2d8c-49ad-849b-38693cae2125 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:50.817421 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3bc353db-2d8c-49ad-849b-38693cae2125 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:50.817847 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3bc353db-2d8c-49ad-849b-38693cae2125 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:50.950108 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-3bc353db-2d8c-49ad-849b-38693cae2125 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:42:50.957775 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-3bc353db-2d8c-49ad-849b-38693cae2125 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a" status: 200 len: 1265 microversion: 2.1 time: 0.155256 Aug 19 16:42:50.958324 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 621/1237] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:42:50 2022] GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:42:51.979092 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-938c2044-2c72-4e4b-ac85-23b448ce10b3 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:42:51.979706 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-938c2044-2c72-4e4b-ac85-23b448ce10b3 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:42:51.986771 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-938c2044-2c72-4e4b-ac85-23b448ce10b3 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:51.987249 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-938c2044-2c72-4e4b-ac85-23b448ce10b3 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:51.987711 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-938c2044-2c72-4e4b-ac85-23b448ce10b3 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:51.988393 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-938c2044-2c72-4e4b-ac85-23b448ce10b3 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:51.988875 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-938c2044-2c72-4e4b-ac85-23b448ce10b3 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:51.989299 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-938c2044-2c72-4e4b-ac85-23b448ce10b3 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:52.115423 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-938c2044-2c72-4e4b-ac85-23b448ce10b3 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:42:52.122912 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-938c2044-2c72-4e4b-ac85-23b448ce10b3 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a" status: 200 len: 1265 microversion: 2.1 time: 0.147933 Aug 19 16:42:52.123989 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 617/1238] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:42:51 2022] GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:42:53.144342 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-00b2ff90-7ef4-42dc-8be9-7acfbf71271f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:42:53.144993 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-00b2ff90-7ef4-42dc-8be9-7acfbf71271f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:42:53.151728 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-00b2ff90-7ef4-42dc-8be9-7acfbf71271f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:53.152229 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-00b2ff90-7ef4-42dc-8be9-7acfbf71271f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:53.152661 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-00b2ff90-7ef4-42dc-8be9-7acfbf71271f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:53.153429 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-00b2ff90-7ef4-42dc-8be9-7acfbf71271f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:53.153964 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-00b2ff90-7ef4-42dc-8be9-7acfbf71271f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:53.154395 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-00b2ff90-7ef4-42dc-8be9-7acfbf71271f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:53.283668 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-00b2ff90-7ef4-42dc-8be9-7acfbf71271f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:42:53.291274 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-00b2ff90-7ef4-42dc-8be9-7acfbf71271f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a" status: 200 len: 1265 microversion: 2.1 time: 0.150767 Aug 19 16:42:53.291775 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 622/1239] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:42:53 2022] GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:42:54.311609 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f4c98692-7342-481a-991e-45019216fdfe tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:42:54.312468 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f4c98692-7342-481a-991e-45019216fdfe tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:42:54.318837 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f4c98692-7342-481a-991e-45019216fdfe tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:54.319320 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f4c98692-7342-481a-991e-45019216fdfe tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:54.319755 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f4c98692-7342-481a-991e-45019216fdfe tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:54.320440 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f4c98692-7342-481a-991e-45019216fdfe tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:54.320923 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f4c98692-7342-481a-991e-45019216fdfe tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:54.321350 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f4c98692-7342-481a-991e-45019216fdfe tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:54.453644 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f4c98692-7342-481a-991e-45019216fdfe tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:42:54.461232 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f4c98692-7342-481a-991e-45019216fdfe tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a" status: 200 len: 1265 microversion: 2.1 time: 0.153620 Aug 19 16:42:54.461795 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 618/1240] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:42:54 2022] GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:42:55.483535 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-9d4af4ac-0585-4eb9-9449-48cf1811d54d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:42:55.484154 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-9d4af4ac-0585-4eb9-9449-48cf1811d54d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:42:55.486579 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=2 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:55.487395 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell0:SELECT=6 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:55.493498 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9d4af4ac-0585-4eb9-9449-48cf1811d54d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:55.493988 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9d4af4ac-0585-4eb9-9449-48cf1811d54d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:55.494427 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9d4af4ac-0585-4eb9-9449-48cf1811d54d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:55.495124 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9d4af4ac-0585-4eb9-9449-48cf1811d54d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:55.495580 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9d4af4ac-0585-4eb9-9449-48cf1811d54d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:55.496008 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-9d4af4ac-0585-4eb9-9449-48cf1811d54d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:55.629739 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-9d4af4ac-0585-4eb9-9449-48cf1811d54d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:42:55.637634 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-9d4af4ac-0585-4eb9-9449-48cf1811d54d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a" status: 200 len: 1265 microversion: 2.1 time: 0.158587 Aug 19 16:42:55.638206 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 623/1241] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:42:55 2022] GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:42:56.659059 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-a3ba81a0-5844-444d-b511-052e1a345c3f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:42:56.659680 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-a3ba81a0-5844-444d-b511-052e1a345c3f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:42:56.662126 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell0:SELECT=2 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:42:56.667475 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a3ba81a0-5844-444d-b511-052e1a345c3f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:56.667963 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a3ba81a0-5844-444d-b511-052e1a345c3f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:56.668402 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a3ba81a0-5844-444d-b511-052e1a345c3f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:56.669144 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a3ba81a0-5844-444d-b511-052e1a345c3f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:56.669605 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a3ba81a0-5844-444d-b511-052e1a345c3f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:56.670035 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-a3ba81a0-5844-444d-b511-052e1a345c3f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:56.801081 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-a3ba81a0-5844-444d-b511-052e1a345c3f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:42:56.808672 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-a3ba81a0-5844-444d-b511-052e1a345c3f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a" status: 200 len: 1265 microversion: 2.1 time: 0.154251 Aug 19 16:42:56.809269 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 619/1242] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:42:56 2022] GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:42:57.830792 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2d592232-a7d3-4d47-b738-87365b7f385d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:42:57.831402 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2d592232-a7d3-4d47-b738-87365b7f385d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:42:57.837448 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2d592232-a7d3-4d47-b738-87365b7f385d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:57.837929 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2d592232-a7d3-4d47-b738-87365b7f385d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:57.838365 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2d592232-a7d3-4d47-b738-87365b7f385d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:57.839048 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2d592232-a7d3-4d47-b738-87365b7f385d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:57.839529 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2d592232-a7d3-4d47-b738-87365b7f385d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:57.839953 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2d592232-a7d3-4d47-b738-87365b7f385d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:57.967441 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2d592232-a7d3-4d47-b738-87365b7f385d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:42:57.975156 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2d592232-a7d3-4d47-b738-87365b7f385d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a" status: 200 len: 1265 microversion: 2.1 time: 0.149292 Aug 19 16:42:57.975713 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 624/1243] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:42:57 2022] GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:42:58.995947 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f0a841f8-7a3f-433d-8e63-8cc20d9a7f60 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:42:58.997324 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f0a841f8-7a3f-433d-8e63-8cc20d9a7f60 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:42:59.005855 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f0a841f8-7a3f-433d-8e63-8cc20d9a7f60 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:59.006410 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f0a841f8-7a3f-433d-8e63-8cc20d9a7f60 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:59.006775 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-08718101-aeed-4103-9ee5-fee61e267354 req-dbe2d98c-50df-4fc7-b53a-d4420b7fef12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "080f26e7-95bb-467f-8a36-b1b1b425fa6a", "name": "network-vif-plugged", "status": "completed", "tag": "8ebcfe06-c492-4177-9ecb-14663d731a3b"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:42:59.007247 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f0a841f8-7a3f-433d-8e63-8cc20d9a7f60 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:59.007871 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f0a841f8-7a3f-433d-8e63-8cc20d9a7f60 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:59.008404 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f0a841f8-7a3f-433d-8e63-8cc20d9a7f60 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:59.009190 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f0a841f8-7a3f-433d-8e63-8cc20d9a7f60 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:59.016659 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-08718101-aeed-4103-9ee5-fee61e267354 req-dbe2d98c-50df-4fc7-b53a-d4420b7fef12 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:42:59.017160 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-08718101-aeed-4103-9ee5-fee61e267354 req-dbe2d98c-50df-4fc7-b53a-d4420b7fef12 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:42:59.017594 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-08718101-aeed-4103-9ee5-fee61e267354 req-dbe2d98c-50df-4fc7-b53a-d4420b7fef12 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:42:59.028511 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-08718101-aeed-4103-9ee5-fee61e267354 req-dbe2d98c-50df-4fc7-b53a-d4420b7fef12 service nova] Creating event network-vif-plugged:8ebcfe06-c492-4177-9ecb-14663d731a3b for instance 080f26e7-95bb-467f-8a36-b1b1b425fa6a on hv-cinder-83124 Aug 19 16:42:59.034673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-08718101-aeed-4103-9ee5-fee61e267354 req-dbe2d98c-50df-4fc7-b53a-d4420b7fef12 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096984 Aug 19 16:42:59.035466 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 620/1244] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:42:59.146538 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f0a841f8-7a3f-433d-8e63-8cc20d9a7f60 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:42:59.154410 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f0a841f8-7a3f-433d-8e63-8cc20d9a7f60 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a" status: 200 len: 1265 microversion: 2.1 time: 0.162865 Aug 19 16:42:59.154947 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 625/1245] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:42:58 2022] GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:43:00.176175 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-75050ae3-3384-4816-96b8-dd2266ac339f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:43:00.176962 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-75050ae3-3384-4816-96b8-dd2266ac339f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:43:00.183021 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-75050ae3-3384-4816-96b8-dd2266ac339f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:43:00.183494 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-75050ae3-3384-4816-96b8-dd2266ac339f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:43:00.183924 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-75050ae3-3384-4816-96b8-dd2266ac339f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:43:00.184605 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-75050ae3-3384-4816-96b8-dd2266ac339f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:43:00.185090 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-75050ae3-3384-4816-96b8-dd2266ac339f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:43:00.185512 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-75050ae3-3384-4816-96b8-dd2266ac339f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:43:00.317827 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-75050ae3-3384-4816-96b8-dd2266ac339f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:43:00.325393 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-75050ae3-3384-4816-96b8-dd2266ac339f tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a" status: 200 len: 1265 microversion: 2.1 time: 0.153867 Aug 19 16:43:00.325947 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 621/1246] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:43:00 2022] GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:43:01.345869 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-292b5024-db3e-4d84-bbc6-be3cde8e12bf tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:43:01.346414 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-292b5024-db3e-4d84-bbc6-be3cde8e12bf tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:43:01.352976 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-292b5024-db3e-4d84-bbc6-be3cde8e12bf tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:43:01.353460 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-292b5024-db3e-4d84-bbc6-be3cde8e12bf tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:43:01.353898 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-292b5024-db3e-4d84-bbc6-be3cde8e12bf tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:43:01.354588 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-292b5024-db3e-4d84-bbc6-be3cde8e12bf tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:43:01.355066 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-292b5024-db3e-4d84-bbc6-be3cde8e12bf tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:43:01.355489 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-292b5024-db3e-4d84-bbc6-be3cde8e12bf tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:43:01.486257 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-292b5024-db3e-4d84-bbc6-be3cde8e12bf tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:43:01.493974 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-292b5024-db3e-4d84-bbc6-be3cde8e12bf tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a" status: 200 len: 1452 microversion: 2.1 time: 0.152625 Aug 19 16:43:01.494536 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 626/1247] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:43:01 2022] GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:43:01.513936 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-07725d3c-c44b-4134-9f25-8cc139b32bb0 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:43:01.514549 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-07725d3c-c44b-4134-9f25-8cc139b32bb0 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:43:01.521438 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-07725d3c-c44b-4134-9f25-8cc139b32bb0 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:43:01.521922 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-07725d3c-c44b-4134-9f25-8cc139b32bb0 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:43:01.522356 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-07725d3c-c44b-4134-9f25-8cc139b32bb0 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:43:01.523041 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-07725d3c-c44b-4134-9f25-8cc139b32bb0 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:43:01.523497 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-07725d3c-c44b-4134-9f25-8cc139b32bb0 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:43:01.523922 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-07725d3c-c44b-4134-9f25-8cc139b32bb0 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:43:01.650804 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-07725d3c-c44b-4134-9f25-8cc139b32bb0 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:43:01.658653 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-07725d3c-c44b-4134-9f25-8cc139b32bb0 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a" status: 200 len: 1452 microversion: 2.1 time: 0.148456 Aug 19 16:43:01.659245 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 622/1248] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:43:01 2022] GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:43:03.764001 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-0df6dc1f-75db-4019-a081-65ece703e826 req-992e034c-c107-4489-b188-a739bd4f8792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "080f26e7-95bb-467f-8a36-b1b1b425fa6a", "tag": "8ebcfe06-c492-4177-9ecb-14663d731a3b"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:43:03.775296 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-0df6dc1f-75db-4019-a081-65ece703e826 req-992e034c-c107-4489-b188-a739bd4f8792 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:43:03.775807 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-0df6dc1f-75db-4019-a081-65ece703e826 req-992e034c-c107-4489-b188-a739bd4f8792 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:43:03.776236 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-0df6dc1f-75db-4019-a081-65ece703e826 req-992e034c-c107-4489-b188-a739bd4f8792 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:43:03.789910 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-0df6dc1f-75db-4019-a081-65ece703e826 req-992e034c-c107-4489-b188-a739bd4f8792 service nova] Creating event network-changed:8ebcfe06-c492-4177-9ecb-14663d731a3b for instance 080f26e7-95bb-467f-8a36-b1b1b425fa6a on hv-cinder-83124 Aug 19 16:43:03.794842 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-0df6dc1f-75db-4019-a081-65ece703e826 req-992e034c-c107-4489-b188-a739bd4f8792 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034644 Aug 19 16:43:03.795420 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 627/1249] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:44:01.270405 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-7f008b54-d478-4ddc-a77c-75844f5b2d2b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:44:01.270962 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-7f008b54-d478-4ddc-a77c-75844f5b2d2b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:01.273099 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=20 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:01.273838 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=44 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:01.279406 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f008b54-d478-4ddc-a77c-75844f5b2d2b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:01.279885 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f008b54-d478-4ddc-a77c-75844f5b2d2b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:01.280344 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f008b54-d478-4ddc-a77c-75844f5b2d2b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:01.281054 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f008b54-d478-4ddc-a77c-75844f5b2d2b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:01.281508 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f008b54-d478-4ddc-a77c-75844f5b2d2b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:01.281932 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-7f008b54-d478-4ddc-a77c-75844f5b2d2b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:01.304758 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.objects.instance [None req-7f008b54-d478-4ddc-a77c-75844f5b2d2b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lazy-loading 'flavor' on Instance uuid 8aa33ae3-4967-490a-9f6c-81e8d4281a0f {{(pid=127285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 19 16:44:01.377240 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-7f008b54-d478-4ddc-a77c-75844f5b2d2b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "POST /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f/action" status: 202 len: 0 microversion: 2.1 time: 0.110605 Aug 19 16:44:01.377934 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 623/1250] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Aug 19 16:44:01 2022] POST /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:44:01.384937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:01.385684 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=48 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:01.389751 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-77ddc200-9d5d-40f5-9a62-4ed413b483db tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:01.390461 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-77ddc200-9d5d-40f5-9a62-4ed413b483db tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:01.397985 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-77ddc200-9d5d-40f5-9a62-4ed413b483db tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:01.398470 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-77ddc200-9d5d-40f5-9a62-4ed413b483db tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:01.398903 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-77ddc200-9d5d-40f5-9a62-4ed413b483db tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:01.399591 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-77ddc200-9d5d-40f5-9a62-4ed413b483db tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:01.400037 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-77ddc200-9d5d-40f5-9a62-4ed413b483db tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:01.400459 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-77ddc200-9d5d-40f5-9a62-4ed413b483db tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:01.538688 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-77ddc200-9d5d-40f5-9a62-4ed413b483db tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:01.546452 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-77ddc200-9d5d-40f5-9a62-4ed413b483db tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1567 microversion: 2.1 time: 0.163281 Aug 19 16:44:01.547038 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 628/1251] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:01 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:02.567976 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e801e73a-d1e7-4965-8712-db82093aa230 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:02.568679 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e801e73a-d1e7-4965-8712-db82093aa230 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:02.576254 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e801e73a-d1e7-4965-8712-db82093aa230 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:02.576739 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e801e73a-d1e7-4965-8712-db82093aa230 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:02.577206 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e801e73a-d1e7-4965-8712-db82093aa230 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:02.577898 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e801e73a-d1e7-4965-8712-db82093aa230 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:02.578353 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e801e73a-d1e7-4965-8712-db82093aa230 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:02.578781 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e801e73a-d1e7-4965-8712-db82093aa230 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:02.708661 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-e801e73a-d1e7-4965-8712-db82093aa230 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:02.716670 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e801e73a-d1e7-4965-8712-db82093aa230 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1567 microversion: 2.1 time: 0.152983 Aug 19 16:44:02.717248 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 624/1252] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:02 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:03.737343 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-2712311e-22f0-4798-a6e0-ef4a27a21281 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:03.737986 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-2712311e-22f0-4798-a6e0-ef4a27a21281 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:03.744455 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2712311e-22f0-4798-a6e0-ef4a27a21281 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:03.744967 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2712311e-22f0-4798-a6e0-ef4a27a21281 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:03.745405 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2712311e-22f0-4798-a6e0-ef4a27a21281 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:03.746087 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2712311e-22f0-4798-a6e0-ef4a27a21281 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:03.746538 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2712311e-22f0-4798-a6e0-ef4a27a21281 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:03.746960 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-2712311e-22f0-4798-a6e0-ef4a27a21281 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:03.873803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-2712311e-22f0-4798-a6e0-ef4a27a21281 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:03.881486 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-2712311e-22f0-4798-a6e0-ef4a27a21281 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1567 microversion: 2.1 time: 0.147974 Aug 19 16:44:03.882660 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 629/1253] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:03 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:04.905158 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d4a9f0e4-b880-4d34-936a-127ccb1ba269 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:04.905762 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d4a9f0e4-b880-4d34-936a-127ccb1ba269 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:04.912229 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d4a9f0e4-b880-4d34-936a-127ccb1ba269 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:04.912651 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d4a9f0e4-b880-4d34-936a-127ccb1ba269 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:04.913785 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d4a9f0e4-b880-4d34-936a-127ccb1ba269 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:04.914491 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d4a9f0e4-b880-4d34-936a-127ccb1ba269 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:04.914943 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d4a9f0e4-b880-4d34-936a-127ccb1ba269 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:04.915363 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d4a9f0e4-b880-4d34-936a-127ccb1ba269 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:05.044518 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-d4a9f0e4-b880-4d34-936a-127ccb1ba269 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:05.052071 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d4a9f0e4-b880-4d34-936a-127ccb1ba269 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1567 microversion: 2.1 time: 0.150964 Aug 19 16:44:05.052807 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 625/1254] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:04 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:06.074220 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-5ab55a73-7a9b-4283-8a3f-e9010fc2cbe4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:06.074821 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-5ab55a73-7a9b-4283-8a3f-e9010fc2cbe4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:06.081353 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5ab55a73-7a9b-4283-8a3f-e9010fc2cbe4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:06.081830 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5ab55a73-7a9b-4283-8a3f-e9010fc2cbe4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:06.082262 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5ab55a73-7a9b-4283-8a3f-e9010fc2cbe4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:06.082948 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5ab55a73-7a9b-4283-8a3f-e9010fc2cbe4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:06.083398 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5ab55a73-7a9b-4283-8a3f-e9010fc2cbe4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:06.083825 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-5ab55a73-7a9b-4283-8a3f-e9010fc2cbe4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:06.215126 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-5ab55a73-7a9b-4283-8a3f-e9010fc2cbe4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:06.223038 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-5ab55a73-7a9b-4283-8a3f-e9010fc2cbe4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1567 microversion: 2.1 time: 0.153157 Aug 19 16:44:06.223613 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 630/1255] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:06 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:07.245146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-6a4f9c21-3062-4dac-bcd2-da65438c258b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:07.245872 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-6a4f9c21-3062-4dac-bcd2-da65438c258b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:07.252235 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6a4f9c21-3062-4dac-bcd2-da65438c258b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:07.252712 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6a4f9c21-3062-4dac-bcd2-da65438c258b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:07.253205 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6a4f9c21-3062-4dac-bcd2-da65438c258b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:07.253892 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6a4f9c21-3062-4dac-bcd2-da65438c258b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:07.254346 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6a4f9c21-3062-4dac-bcd2-da65438c258b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:07.254767 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-6a4f9c21-3062-4dac-bcd2-da65438c258b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:07.385626 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-6a4f9c21-3062-4dac-bcd2-da65438c258b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:07.393246 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-6a4f9c21-3062-4dac-bcd2-da65438c258b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1567 microversion: 2.1 time: 0.152634 Aug 19 16:44:07.393801 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 626/1256] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:07 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:08.414435 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-411f0977-abd9-4fd1-97be-ca3fe8f027dd tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:08.415030 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-411f0977-abd9-4fd1-97be-ca3fe8f027dd tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:08.421499 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-411f0977-abd9-4fd1-97be-ca3fe8f027dd tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:08.421979 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-411f0977-abd9-4fd1-97be-ca3fe8f027dd tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:08.422413 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-411f0977-abd9-4fd1-97be-ca3fe8f027dd tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:08.423099 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-411f0977-abd9-4fd1-97be-ca3fe8f027dd tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:08.423611 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-411f0977-abd9-4fd1-97be-ca3fe8f027dd tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:08.424035 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-411f0977-abd9-4fd1-97be-ca3fe8f027dd tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:08.552221 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-411f0977-abd9-4fd1-97be-ca3fe8f027dd tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:08.560489 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-411f0977-abd9-4fd1-97be-ca3fe8f027dd tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1567 microversion: 2.1 time: 0.150037 Aug 19 16:44:08.561087 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 631/1257] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:08 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:09.582528 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-aa2ad17a-419a-4f67-b10e-a1b21d0fc526 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:09.583141 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-aa2ad17a-419a-4f67-b10e-a1b21d0fc526 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:09.590166 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-aa2ad17a-419a-4f67-b10e-a1b21d0fc526 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:09.590644 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-aa2ad17a-419a-4f67-b10e-a1b21d0fc526 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:09.591078 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-aa2ad17a-419a-4f67-b10e-a1b21d0fc526 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:09.591759 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-aa2ad17a-419a-4f67-b10e-a1b21d0fc526 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:09.592210 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-aa2ad17a-419a-4f67-b10e-a1b21d0fc526 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:09.592633 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-aa2ad17a-419a-4f67-b10e-a1b21d0fc526 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:09.971195 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-aa2ad17a-419a-4f67-b10e-a1b21d0fc526 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:09.978956 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-aa2ad17a-419a-4f67-b10e-a1b21d0fc526 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1567 microversion: 2.1 time: 0.400423 Aug 19 16:44:09.979588 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 627/1258] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:09 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1567 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:11.000096 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-00225473-c622-4ff2-9163-290ceebee599 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:11.000709 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-00225473-c622-4ff2-9163-290ceebee599 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:11.007189 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-00225473-c622-4ff2-9163-290ceebee599 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:11.007794 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-00225473-c622-4ff2-9163-290ceebee599 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:11.008287 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-00225473-c622-4ff2-9163-290ceebee599 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:11.009044 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-00225473-c622-4ff2-9163-290ceebee599 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:11.009497 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-00225473-c622-4ff2-9163-290ceebee599 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:11.009919 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-00225473-c622-4ff2-9163-290ceebee599 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:11.140242 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-00225473-c622-4ff2-9163-290ceebee599 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:11.147859 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-00225473-c622-4ff2-9163-290ceebee599 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1567 microversion: 2.1 time: 0.151701 Aug 19 16:44:11.149104 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 632/1259] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:10 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:12.169995 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-210e9e30-4439-401f-90f9-ad3cb1903086 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:12.170640 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-210e9e30-4439-401f-90f9-ad3cb1903086 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:12.177311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-210e9e30-4439-401f-90f9-ad3cb1903086 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:12.177801 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-210e9e30-4439-401f-90f9-ad3cb1903086 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:12.178241 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-210e9e30-4439-401f-90f9-ad3cb1903086 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:12.178937 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-210e9e30-4439-401f-90f9-ad3cb1903086 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:12.179434 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-210e9e30-4439-401f-90f9-ad3cb1903086 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:12.180667 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-210e9e30-4439-401f-90f9-ad3cb1903086 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:12.310336 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-210e9e30-4439-401f-90f9-ad3cb1903086 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:12.318444 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-210e9e30-4439-401f-90f9-ad3cb1903086 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1567 microversion: 2.1 time: 0.152273 Aug 19 16:44:12.319008 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 628/1260] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:12 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:13.339634 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-97a61429-d2d5-4b9c-bac4-f43514402fd6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:13.340172 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-97a61429-d2d5-4b9c-bac4-f43514402fd6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:13.346829 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-97a61429-d2d5-4b9c-bac4-f43514402fd6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:13.347312 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-97a61429-d2d5-4b9c-bac4-f43514402fd6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:13.347757 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-97a61429-d2d5-4b9c-bac4-f43514402fd6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:13.348444 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-97a61429-d2d5-4b9c-bac4-f43514402fd6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:13.348927 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-97a61429-d2d5-4b9c-bac4-f43514402fd6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:13.349352 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-97a61429-d2d5-4b9c-bac4-f43514402fd6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:13.485908 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-97a61429-d2d5-4b9c-bac4-f43514402fd6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:13.494330 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-97a61429-d2d5-4b9c-bac4-f43514402fd6 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1567 microversion: 2.1 time: 0.158784 Aug 19 16:44:13.494902 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 633/1261] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:13 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:14.516940 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-4e0e821a-d239-4136-b5de-38fce6d6e7b7 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:14.517557 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-4e0e821a-d239-4136-b5de-38fce6d6e7b7 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:14.524027 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4e0e821a-d239-4136-b5de-38fce6d6e7b7 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:14.524511 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4e0e821a-d239-4136-b5de-38fce6d6e7b7 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:14.524982 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4e0e821a-d239-4136-b5de-38fce6d6e7b7 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:14.525671 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4e0e821a-d239-4136-b5de-38fce6d6e7b7 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:14.526128 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4e0e821a-d239-4136-b5de-38fce6d6e7b7 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:14.526556 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-4e0e821a-d239-4136-b5de-38fce6d6e7b7 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:14.659460 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-4e0e821a-d239-4136-b5de-38fce6d6e7b7 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:14.667316 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-4e0e821a-d239-4136-b5de-38fce6d6e7b7 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1567 microversion: 2.1 time: 0.154174 Aug 19 16:44:14.667870 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 629/1262] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:14 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:15.688837 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f4768346-46d6-40d9-9dbe-362278e191ab tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:15.689372 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f4768346-46d6-40d9-9dbe-362278e191ab tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:15.696359 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f4768346-46d6-40d9-9dbe-362278e191ab tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:15.696868 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f4768346-46d6-40d9-9dbe-362278e191ab tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:15.697549 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f4768346-46d6-40d9-9dbe-362278e191ab tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:15.698234 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f4768346-46d6-40d9-9dbe-362278e191ab tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:15.698681 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f4768346-46d6-40d9-9dbe-362278e191ab tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:15.699101 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f4768346-46d6-40d9-9dbe-362278e191ab tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:15.838318 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f4768346-46d6-40d9-9dbe-362278e191ab tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:15.848186 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f4768346-46d6-40d9-9dbe-362278e191ab tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1508 microversion: 2.1 time: 0.163521 Aug 19 16:44:15.848768 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 634/1263] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:15 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:15.870647 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-57acd0c7-a740-403e-9e17-18135d50df4b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:44:15.871242 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-57acd0c7-a740-403e-9e17-18135d50df4b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:15.877874 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-57acd0c7-a740-403e-9e17-18135d50df4b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:15.878352 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-57acd0c7-a740-403e-9e17-18135d50df4b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:15.878781 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-57acd0c7-a740-403e-9e17-18135d50df4b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:15.879467 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-57acd0c7-a740-403e-9e17-18135d50df4b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:15.879914 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-57acd0c7-a740-403e-9e17-18135d50df4b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:15.880334 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-57acd0c7-a740-403e-9e17-18135d50df4b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:15.982298 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-57acd0c7-a740-403e-9e17-18135d50df4b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127285) unshelve /opt/stack/nova/nova/compute/api.py:4584}} Aug 19 16:44:16.057757 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-57acd0c7-a740-403e-9e17-18135d50df4b tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "POST /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f/action" status: 202 len: 0 microversion: 2.1 time: 0.191128 Aug 19 16:44:16.058510 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 630/1264] 10.222.0.55 () {60 vars in 1278 bytes} [Fri Aug 19 16:44:15 2022] POST /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:44:16.066619 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-3435c58a-630d-4cb8-b5ec-b2b40e675415 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:16.067693 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-3435c58a-630d-4cb8-b5ec-b2b40e675415 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:16.074692 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3435c58a-630d-4cb8-b5ec-b2b40e675415 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:16.075724 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3435c58a-630d-4cb8-b5ec-b2b40e675415 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:16.076166 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3435c58a-630d-4cb8-b5ec-b2b40e675415 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:16.076885 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3435c58a-630d-4cb8-b5ec-b2b40e675415 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:16.077338 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3435c58a-630d-4cb8-b5ec-b2b40e675415 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:16.077760 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-3435c58a-630d-4cb8-b5ec-b2b40e675415 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:16.229318 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-3435c58a-630d-4cb8-b5ec-b2b40e675415 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:16.238178 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-3435c58a-630d-4cb8-b5ec-b2b40e675415 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1516 microversion: 2.1 time: 0.175224 Aug 19 16:44:16.239350 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 635/1265] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:16 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:44:17.214337 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-05a7f4cb-9e46-420f-ba1b-4b61bd21b421 req-5b9539c7-7279-4d26-b0b7-d1352a8132f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aa33ae3-4967-490a-9f6c-81e8d4281a0f", "name": "network-vif-unplugged", "status": "completed", "tag": "a73aa2cc-c181-4f88-a281-4452334ab294"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:44:17.224270 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-05a7f4cb-9e46-420f-ba1b-4b61bd21b421 req-5b9539c7-7279-4d26-b0b7-d1352a8132f2 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:17.224825 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-05a7f4cb-9e46-420f-ba1b-4b61bd21b421 req-5b9539c7-7279-4d26-b0b7-d1352a8132f2 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:17.225408 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-05a7f4cb-9e46-420f-ba1b-4b61bd21b421 req-5b9539c7-7279-4d26-b0b7-d1352a8132f2 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:17.237790 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.compute.server_external_events [req-05a7f4cb-9e46-420f-ba1b-4b61bd21b421 req-5b9539c7-7279-4d26-b0b7-d1352a8132f2 service nova] Unable to find a host for instance 8aa33ae3-4967-490a-9f6c-81e8d4281a0f. Dropping event network-vif-unplugged {{(pid=127285) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 19 16:44:17.238673 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-05a7f4cb-9e46-420f-ba1b-4b61bd21b421 req-5b9539c7-7279-4d26-b0b7-d1352a8132f2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028807 Aug 19 16:44:17.239446 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 631/1266] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 19 16:44:17.260399 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-867c1375-e11a-4101-a6a0-2b99aa68e25a tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:17.261042 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-867c1375-e11a-4101-a6a0-2b99aa68e25a tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:17.267564 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-867c1375-e11a-4101-a6a0-2b99aa68e25a tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:17.268052 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-867c1375-e11a-4101-a6a0-2b99aa68e25a tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:17.268489 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-867c1375-e11a-4101-a6a0-2b99aa68e25a tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:17.269222 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-867c1375-e11a-4101-a6a0-2b99aa68e25a tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:17.269680 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-867c1375-e11a-4101-a6a0-2b99aa68e25a tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:17.270104 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-867c1375-e11a-4101-a6a0-2b99aa68e25a tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:17.403185 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-867c1375-e11a-4101-a6a0-2b99aa68e25a tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:17.411097 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-867c1375-e11a-4101-a6a0-2b99aa68e25a tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1518 microversion: 2.1 time: 0.155241 Aug 19 16:44:17.411663 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 636/1267] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:17 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:18.432696 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-416dfd2e-fd6f-4379-a504-e93fb153048f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:18.433362 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-416dfd2e-fd6f-4379-a504-e93fb153048f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:18.439851 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-416dfd2e-fd6f-4379-a504-e93fb153048f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:18.440334 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-416dfd2e-fd6f-4379-a504-e93fb153048f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:18.440779 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-416dfd2e-fd6f-4379-a504-e93fb153048f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:18.441482 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-416dfd2e-fd6f-4379-a504-e93fb153048f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:18.441933 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-416dfd2e-fd6f-4379-a504-e93fb153048f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:18.442354 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-416dfd2e-fd6f-4379-a504-e93fb153048f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:18.574675 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-416dfd2e-fd6f-4379-a504-e93fb153048f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:18.582476 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-416dfd2e-fd6f-4379-a504-e93fb153048f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1574 microversion: 2.1 time: 0.153812 Aug 19 16:44:18.583044 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 632/1268] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:18 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:19.604025 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-528ac191-2c79-419f-be6d-9cc566d2cbcf tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:19.604657 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-528ac191-2c79-419f-be6d-9cc566d2cbcf tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:19.611037 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-528ac191-2c79-419f-be6d-9cc566d2cbcf tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:19.611509 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-528ac191-2c79-419f-be6d-9cc566d2cbcf tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:19.611937 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-528ac191-2c79-419f-be6d-9cc566d2cbcf tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:19.612611 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-528ac191-2c79-419f-be6d-9cc566d2cbcf tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:19.613091 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-528ac191-2c79-419f-be6d-9cc566d2cbcf tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:19.613506 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-528ac191-2c79-419f-be6d-9cc566d2cbcf tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:19.743118 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-528ac191-2c79-419f-be6d-9cc566d2cbcf tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:19.750806 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-528ac191-2c79-419f-be6d-9cc566d2cbcf tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1574 microversion: 2.1 time: 0.151263 Aug 19 16:44:19.751368 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 637/1269] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:19 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:20.771578 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2cc17d05-7d9b-4cd0-a07d-2dc2e0969cdf tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:20.772222 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2cc17d05-7d9b-4cd0-a07d-2dc2e0969cdf tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:20.778762 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2cc17d05-7d9b-4cd0-a07d-2dc2e0969cdf tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:20.779243 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2cc17d05-7d9b-4cd0-a07d-2dc2e0969cdf tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:20.779675 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2cc17d05-7d9b-4cd0-a07d-2dc2e0969cdf tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:20.780369 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2cc17d05-7d9b-4cd0-a07d-2dc2e0969cdf tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:20.780851 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2cc17d05-7d9b-4cd0-a07d-2dc2e0969cdf tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:20.781279 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2cc17d05-7d9b-4cd0-a07d-2dc2e0969cdf tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:20.912126 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2cc17d05-7d9b-4cd0-a07d-2dc2e0969cdf tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:20.920515 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2cc17d05-7d9b-4cd0-a07d-2dc2e0969cdf tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1574 microversion: 2.1 time: 0.152867 Aug 19 16:44:20.921110 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 633/1270] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:20 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:21.942563 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ea8a1cfe-5e55-48d9-a1f4-d49d287e1022 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:21.943142 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ea8a1cfe-5e55-48d9-a1f4-d49d287e1022 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:21.949803 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea8a1cfe-5e55-48d9-a1f4-d49d287e1022 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:21.950285 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea8a1cfe-5e55-48d9-a1f4-d49d287e1022 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:21.950709 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea8a1cfe-5e55-48d9-a1f4-d49d287e1022 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:21.951390 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea8a1cfe-5e55-48d9-a1f4-d49d287e1022 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:21.951832 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea8a1cfe-5e55-48d9-a1f4-d49d287e1022 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:21.952250 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea8a1cfe-5e55-48d9-a1f4-d49d287e1022 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:22.087394 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-ea8a1cfe-5e55-48d9-a1f4-d49d287e1022 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:22.094989 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ea8a1cfe-5e55-48d9-a1f4-d49d287e1022 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1574 microversion: 2.1 time: 0.156396 Aug 19 16:44:22.095552 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 638/1271] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:21 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:23.116881 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-0585d11e-05ac-4bb6-b994-88c907233932 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:23.117500 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-0585d11e-05ac-4bb6-b994-88c907233932 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:23.124796 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0585d11e-05ac-4bb6-b994-88c907233932 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:23.125288 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0585d11e-05ac-4bb6-b994-88c907233932 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:23.125725 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0585d11e-05ac-4bb6-b994-88c907233932 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:23.126416 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0585d11e-05ac-4bb6-b994-88c907233932 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:23.126872 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0585d11e-05ac-4bb6-b994-88c907233932 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:23.127304 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-0585d11e-05ac-4bb6-b994-88c907233932 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:23.257397 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-0585d11e-05ac-4bb6-b994-88c907233932 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:23.265771 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-0585d11e-05ac-4bb6-b994-88c907233932 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1574 microversion: 2.1 time: 0.152792 Aug 19 16:44:23.266328 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 634/1272] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:23 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:24.287245 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-f01ca060-687e-4235-8995-d5991108df84 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:24.287832 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-f01ca060-687e-4235-8995-d5991108df84 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:24.295026 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f01ca060-687e-4235-8995-d5991108df84 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:24.295498 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f01ca060-687e-4235-8995-d5991108df84 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:24.295926 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f01ca060-687e-4235-8995-d5991108df84 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:24.296606 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f01ca060-687e-4235-8995-d5991108df84 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:24.297082 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f01ca060-687e-4235-8995-d5991108df84 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:24.297499 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-f01ca060-687e-4235-8995-d5991108df84 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:24.425291 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-f01ca060-687e-4235-8995-d5991108df84 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:24.433068 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-f01ca060-687e-4235-8995-d5991108df84 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1574 microversion: 2.1 time: 0.149630 Aug 19 16:44:24.433630 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 639/1273] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:24 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:25.454685 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3eefba45-2022-49a2-ac54-840f33598671 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:25.455230 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-3eefba45-2022-49a2-ac54-840f33598671 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:25.461712 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3eefba45-2022-49a2-ac54-840f33598671 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:25.462259 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3eefba45-2022-49a2-ac54-840f33598671 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:25.462695 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3eefba45-2022-49a2-ac54-840f33598671 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:25.463381 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3eefba45-2022-49a2-ac54-840f33598671 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:25.463838 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3eefba45-2022-49a2-ac54-840f33598671 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:25.464264 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3eefba45-2022-49a2-ac54-840f33598671 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:25.593725 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-3eefba45-2022-49a2-ac54-840f33598671 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:25.601364 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3eefba45-2022-49a2-ac54-840f33598671 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1574 microversion: 2.1 time: 0.150662 Aug 19 16:44:25.601921 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 635/1274] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:25 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:26.623725 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-fa0c05d6-0c60-431d-8408-10c96f502dea tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:26.624338 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-fa0c05d6-0c60-431d-8408-10c96f502dea tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:26.630273 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fa0c05d6-0c60-431d-8408-10c96f502dea tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:26.630750 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fa0c05d6-0c60-431d-8408-10c96f502dea tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:26.631181 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fa0c05d6-0c60-431d-8408-10c96f502dea tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:26.631860 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fa0c05d6-0c60-431d-8408-10c96f502dea tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:26.632306 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fa0c05d6-0c60-431d-8408-10c96f502dea tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:26.632724 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-fa0c05d6-0c60-431d-8408-10c96f502dea tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:26.769388 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-fa0c05d6-0c60-431d-8408-10c96f502dea tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:26.777226 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-fa0c05d6-0c60-431d-8408-10c96f502dea tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1574 microversion: 2.1 time: 0.157540 Aug 19 16:44:26.777786 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 640/1275] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:26 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:27.798025 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-685fe079-f652-4677-bae1-ee5fe294c0ad tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:27.798654 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-685fe079-f652-4677-bae1-ee5fe294c0ad tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:27.805086 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-685fe079-f652-4677-bae1-ee5fe294c0ad tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:27.805577 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-685fe079-f652-4677-bae1-ee5fe294c0ad tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:27.806000 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-685fe079-f652-4677-bae1-ee5fe294c0ad tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:27.806685 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-685fe079-f652-4677-bae1-ee5fe294c0ad tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:27.807133 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-685fe079-f652-4677-bae1-ee5fe294c0ad tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:27.807548 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-685fe079-f652-4677-bae1-ee5fe294c0ad tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:27.936604 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-685fe079-f652-4677-bae1-ee5fe294c0ad tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:27.944340 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-685fe079-f652-4677-bae1-ee5fe294c0ad tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1574 microversion: 2.1 time: 0.150125 Aug 19 16:44:27.944926 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 636/1276] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:27 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:28.966837 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-26a85d7d-6866-4b21-92df-91aa8bb792a4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:28.967376 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-26a85d7d-6866-4b21-92df-91aa8bb792a4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:28.973678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-26a85d7d-6866-4b21-92df-91aa8bb792a4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:28.974172 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-26a85d7d-6866-4b21-92df-91aa8bb792a4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:28.974602 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-26a85d7d-6866-4b21-92df-91aa8bb792a4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:28.975275 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-26a85d7d-6866-4b21-92df-91aa8bb792a4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:28.975716 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-26a85d7d-6866-4b21-92df-91aa8bb792a4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:28.976129 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-26a85d7d-6866-4b21-92df-91aa8bb792a4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:29.109486 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-26a85d7d-6866-4b21-92df-91aa8bb792a4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:29.117079 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-26a85d7d-6866-4b21-92df-91aa8bb792a4 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1574 microversion: 2.1 time: 0.154128 Aug 19 16:44:29.117639 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 641/1277] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:28 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:44:29.378631 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-6bcf1357-241a-46a0-a376-1070a3c5eb7b req-1b35fe3a-123e-4dd9-9dd9-eda3d93bbc4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aa33ae3-4967-490a-9f6c-81e8d4281a0f", "name": "network-vif-plugged", "status": "completed", "tag": "a73aa2cc-c181-4f88-a281-4452334ab294"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:44:29.389128 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-6bcf1357-241a-46a0-a376-1070a3c5eb7b req-1b35fe3a-123e-4dd9-9dd9-eda3d93bbc4c service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:29.389604 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-6bcf1357-241a-46a0-a376-1070a3c5eb7b req-1b35fe3a-123e-4dd9-9dd9-eda3d93bbc4c service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:29.390029 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-6bcf1357-241a-46a0-a376-1070a3c5eb7b req-1b35fe3a-123e-4dd9-9dd9-eda3d93bbc4c service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:29.393958 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:29.403198 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-6bcf1357-241a-46a0-a376-1070a3c5eb7b req-1b35fe3a-123e-4dd9-9dd9-eda3d93bbc4c service nova] Creating event network-vif-plugged:a73aa2cc-c181-4f88-a281-4452334ab294 for instance 8aa33ae3-4967-490a-9f6c-81e8d4281a0f on hv-cinder-83124 Aug 19 16:44:29.408291 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-6bcf1357-241a-46a0-a376-1070a3c5eb7b req-1b35fe3a-123e-4dd9-9dd9-eda3d93bbc4c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033336 Aug 19 16:44:29.408928 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 637/1278] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:44:30.137951 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-0eaacc30-ba3e-49d5-89a5-ffd0fd0a9929 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:30.138553 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-0eaacc30-ba3e-49d5-89a5-ffd0fd0a9929 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:30.144915 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0eaacc30-ba3e-49d5-89a5-ffd0fd0a9929 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:30.145389 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0eaacc30-ba3e-49d5-89a5-ffd0fd0a9929 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:30.146746 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0eaacc30-ba3e-49d5-89a5-ffd0fd0a9929 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:30.146746 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0eaacc30-ba3e-49d5-89a5-ffd0fd0a9929 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:30.146981 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0eaacc30-ba3e-49d5-89a5-ffd0fd0a9929 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:30.147326 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-0eaacc30-ba3e-49d5-89a5-ffd0fd0a9929 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:30.279550 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-0eaacc30-ba3e-49d5-89a5-ffd0fd0a9929 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:30.287171 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-0eaacc30-ba3e-49d5-89a5-ffd0fd0a9929 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1574 microversion: 2.1 time: 0.153305 Aug 19 16:44:30.287727 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 642/1279] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:30 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:31.309835 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-16375dec-ed35-4dd0-bd6c-25bd959bb3b0 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:31.310534 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-16375dec-ed35-4dd0-bd6c-25bd959bb3b0 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:31.312425 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:31.318473 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-16375dec-ed35-4dd0-bd6c-25bd959bb3b0 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:31.318955 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-16375dec-ed35-4dd0-bd6c-25bd959bb3b0 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:31.319390 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-16375dec-ed35-4dd0-bd6c-25bd959bb3b0 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:31.320078 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-16375dec-ed35-4dd0-bd6c-25bd959bb3b0 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:31.320531 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-16375dec-ed35-4dd0-bd6c-25bd959bb3b0 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:31.320987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-16375dec-ed35-4dd0-bd6c-25bd959bb3b0 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:31.454440 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-16375dec-ed35-4dd0-bd6c-25bd959bb3b0 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:31.462259 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-16375dec-ed35-4dd0-bd6c-25bd959bb3b0 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1561 microversion: 2.1 time: 0.157786 Aug 19 16:44:31.462857 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 638/1280] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:31 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:34.003381 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-4393f401-3b69-4abd-a88b-e09553afe3e2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:34.003894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-4393f401-3b69-4abd-a88b-e09553afe3e2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:34.006221 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=31 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:34.013945 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4393f401-3b69-4abd-a88b-e09553afe3e2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:34.013945 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4393f401-3b69-4abd-a88b-e09553afe3e2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:34.014310 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4393f401-3b69-4abd-a88b-e09553afe3e2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:34.015146 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4393f401-3b69-4abd-a88b-e09553afe3e2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:34.015945 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4393f401-3b69-4abd-a88b-e09553afe3e2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:34.015945 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-4393f401-3b69-4abd-a88b-e09553afe3e2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:34.020074 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=91 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:44:34.042679 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-4393f401-3b69-4abd-a88b-e09553afe3e2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Going to try to terminate instance {{(pid=127284) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:44:34.063839 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-7e636b13-338a-4988-8cfe-6ade7c26751e req-8429bf9d-b418-45a2-a507-fdb6739e0f9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "080f26e7-95bb-467f-8a36-b1b1b425fa6a", "tag": "8ebcfe06-c492-4177-9ecb-14663d731a3b"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:44:34.074498 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-7e636b13-338a-4988-8cfe-6ade7c26751e req-8429bf9d-b418-45a2-a507-fdb6739e0f9e service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:34.075055 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-7e636b13-338a-4988-8cfe-6ade7c26751e req-8429bf9d-b418-45a2-a507-fdb6739e0f9e service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:34.075708 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-7e636b13-338a-4988-8cfe-6ade7c26751e req-8429bf9d-b418-45a2-a507-fdb6739e0f9e service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:34.088194 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-7e636b13-338a-4988-8cfe-6ade7c26751e req-8429bf9d-b418-45a2-a507-fdb6739e0f9e service nova] Creating event network-changed:8ebcfe06-c492-4177-9ecb-14663d731a3b for instance 080f26e7-95bb-467f-8a36-b1b1b425fa6a on hv-cinder-83124 Aug 19 16:44:34.093736 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-7e636b13-338a-4988-8cfe-6ade7c26751e req-8429bf9d-b418-45a2-a507-fdb6739e0f9e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091480 Aug 19 16:44:34.095148 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 639/1281] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:44:34.123303 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-4393f401-3b69-4abd-a88b-e09553afe3e2 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "DELETE /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a" status: 204 len: 0 microversion: 2.1 time: 0.123960 Aug 19 16:44:34.124154 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 643/1282] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:44:33 2022] DELETE /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:44:34.132799 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-c7bd31ad-9b36-4ac1-9a19-2074ba5606cd tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:34.133505 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-c7bd31ad-9b36-4ac1-9a19-2074ba5606cd tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:34.142486 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c7bd31ad-9b36-4ac1-9a19-2074ba5606cd tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:34.143183 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c7bd31ad-9b36-4ac1-9a19-2074ba5606cd tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:34.143631 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c7bd31ad-9b36-4ac1-9a19-2074ba5606cd tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:34.144599 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c7bd31ad-9b36-4ac1-9a19-2074ba5606cd tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:34.145116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c7bd31ad-9b36-4ac1-9a19-2074ba5606cd tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:34.145972 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-c7bd31ad-9b36-4ac1-9a19-2074ba5606cd tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:34.285649 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-c7bd31ad-9b36-4ac1-9a19-2074ba5606cd tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:34.293863 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-c7bd31ad-9b36-4ac1-9a19-2074ba5606cd tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a" status: 200 len: 1577 microversion: 2.1 time: 0.165271 Aug 19 16:44:34.294432 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 640/1283] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:34 2022] GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:35.315905 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-c607b09a-e82b-41ac-8083-41d1c59bd258 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:35.316603 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-c607b09a-e82b-41ac-8083-41d1c59bd258 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:35.323558 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c607b09a-e82b-41ac-8083-41d1c59bd258 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:35.324290 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c607b09a-e82b-41ac-8083-41d1c59bd258 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:35.324718 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c607b09a-e82b-41ac-8083-41d1c59bd258 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:35.325419 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c607b09a-e82b-41ac-8083-41d1c59bd258 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:35.325863 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c607b09a-e82b-41ac-8083-41d1c59bd258 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:35.326282 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-c607b09a-e82b-41ac-8083-41d1c59bd258 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:35.532395 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-c607b09a-e82b-41ac-8083-41d1c59bd258 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:35.540061 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-c607b09a-e82b-41ac-8083-41d1c59bd258 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a" status: 200 len: 1577 microversion: 2.1 time: 0.228440 Aug 19 16:44:35.540656 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 644/1284] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:35 2022] GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:36.520150 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-089af1c2-8700-41a1-a19e-b4b85c50ac0f req-a6c4aa8d-527e-480d-bd1f-559f4f4bd8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "080f26e7-95bb-467f-8a36-b1b1b425fa6a", "name": "network-vif-deleted", "tag": "8ebcfe06-c492-4177-9ecb-14663d731a3b"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:44:36.531730 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-089af1c2-8700-41a1-a19e-b4b85c50ac0f req-a6c4aa8d-527e-480d-bd1f-559f4f4bd8d9 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:36.532212 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-089af1c2-8700-41a1-a19e-b4b85c50ac0f req-a6c4aa8d-527e-480d-bd1f-559f4f4bd8d9 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:36.532641 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-089af1c2-8700-41a1-a19e-b4b85c50ac0f req-a6c4aa8d-527e-480d-bd1f-559f4f4bd8d9 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:36.546478 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-089af1c2-8700-41a1-a19e-b4b85c50ac0f req-a6c4aa8d-527e-480d-bd1f-559f4f4bd8d9 service nova] Creating event network-vif-deleted:8ebcfe06-c492-4177-9ecb-14663d731a3b for instance 080f26e7-95bb-467f-8a36-b1b1b425fa6a on hv-cinder-83124 Aug 19 16:44:36.551760 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-089af1c2-8700-41a1-a19e-b4b85c50ac0f req-a6c4aa8d-527e-480d-bd1f-559f4f4bd8d9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035617 Aug 19 16:44:36.552740 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 641/1285] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:44:36.562017 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-94f9fb1c-bca9-48fd-ac9e-aeb74d211726 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:36.562634 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-94f9fb1c-bca9-48fd-ac9e-aeb74d211726 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:36.569231 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-94f9fb1c-bca9-48fd-ac9e-aeb74d211726 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:36.569740 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-94f9fb1c-bca9-48fd-ac9e-aeb74d211726 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:36.570173 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-94f9fb1c-bca9-48fd-ac9e-aeb74d211726 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:36.570860 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-94f9fb1c-bca9-48fd-ac9e-aeb74d211726 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:36.571334 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-94f9fb1c-bca9-48fd-ac9e-aeb74d211726 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:36.571830 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-94f9fb1c-bca9-48fd-ac9e-aeb74d211726 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:36.634528 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-94f9fb1c-bca9-48fd-ac9e-aeb74d211726 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:36.642916 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-94f9fb1c-bca9-48fd-ac9e-aeb74d211726 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a" status: 200 len: 1224 microversion: 2.1 time: 0.084742 Aug 19 16:44:36.643661 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 645/1286] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:36 2022] GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:44:37.664128 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e693a591-7dc3-432f-8df4-9954922941c7 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:37.664836 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-e693a591-7dc3-432f-8df4-9954922941c7 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 080f26e7-95bb-467f-8a36-b1b1b425fa6a] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:37.671606 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e693a591-7dc3-432f-8df4-9954922941c7 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:37.672078 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e693a591-7dc3-432f-8df4-9954922941c7 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:37.672505 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e693a591-7dc3-432f-8df4-9954922941c7 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:37.673210 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e693a591-7dc3-432f-8df4-9954922941c7 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:37.673654 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e693a591-7dc3-432f-8df4-9954922941c7 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:37.674078 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-e693a591-7dc3-432f-8df4-9954922941c7 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:37.686728 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-e693a591-7dc3-432f-8df4-9954922941c7 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] HTTP exception thrown: Instance 080f26e7-95bb-467f-8a36-b1b1b425fa6a could not be found. Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e693a591-7dc3-432f-8df4-9954922941c7 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Request method failure captured: Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a HTTP/1.1 Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7wwtaTPS4yhEMKX53xcC7hL62iip6pDRARiMrXKgIHc7CY848PNsJg1aSVdSjM5SD_z3fgBhz_mquV2-kYy_8uXoMWXhLsg9HRfkUwFsduJc4-aBd2DS7iN9bYmJzu-APLqRRI_lEHrhR-PflScv1JC-2oA2p5kwrfuzd0dYkyYGkc Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: 5181e8549b3a439c8921319d6957f670 Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-TestVolumeBootPattern-760970128 Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:44:37.688311 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:44:37.690116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5181e8549b3a439c8921319d6957f670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5181e8549b3a439c8921319d6957f670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5181e8549b3a439c8921319d6957f670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5181e8549b3a439c8921319d6957f670"}]}] Aug 19 16:44:37.690116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-TestVolumeBootPattern-760970128 Aug 19 16:44:37.690116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: 5181e8549b3a439c8921319d6957f670 Aug 19 16:44:37.690116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-TestVolumeBootPattern-760970128 Aug 19 16:44:37.690116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-TestVolumeBootPattern-760970128-project Aug 19 16:44:37.690116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:44:37.690116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:44:37.690116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: f989b6fded53458b85b39789a32a39e4 Aug 19 16:44:37.690116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-TestVolumeBootPattern-760970128-project Aug 19 16:44:37.690116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:44:37.690116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance 080f26e7-95bb-467f-8a36-b1b1b425fa6a could not be found. Aug 19 16:44:37.690116 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': '080f26e7-95bb-467f-8a36-b1b1b425fa6a'} Aug 19 16:44:37.691105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:44:37.691105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:44:37.691105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:44:37.691105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:44:37.691105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:44:37.691105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:44:37.691105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:44:37.691105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:44:37.691105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:44:37.691105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:44:37.691105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 080f26e7-95bb-467f-8a36-b1b1b425fa6a could not be found. Aug 19 16:44:37.691105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:44:37.691105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:44:37.691105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:44:37.691105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:44:37.691105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:44:37.691105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:44:37.691105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:44:37.691105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:44:37.691105 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:44:37.692859 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:44:37.692859 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:44:37.692859 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:44:37.692859 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:44:37.692859 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:44:37.692859 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:44:37.692859 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:44:37.692859 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 080f26e7-95bb-467f-8a36-b1b1b425fa6a could not be found. Aug 19 16:44:37.692859 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:44:37.692859 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:44:37.692859 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:44:37.692859 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:44:37.692859 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:44:37.692859 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:44:37.692859 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:44:37.692859 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:44:37.692859 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 080f26e7-95bb-467f-8a36-b1b1b425fa6a could not be found. Aug 19 16:44:37.692859 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:44:37.694336 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-e693a591-7dc3-432f-8df4-9954922941c7 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Returning 404 to user: Instance 080f26e7-95bb-467f-8a36-b1b1b425fa6a could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:44:37.694336 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-e693a591-7dc3-432f-8df4-9954922941c7 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a" status: 404 len: 111 microversion: 2.1 time: 0.029800 Aug 19 16:44:37.694336 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 642/1287] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:37 2022] GET /compute/v2.1/servers/080f26e7-95bb-467f-8a36-b1b1b425fa6a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:44:40.726537 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-941a7557-9294-4458-948f-7934a4c72632 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:40.727095 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-941a7557-9294-4458-948f-7934a4c72632 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:40.728267 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-1021c40c-0ccb-48bf-acb6-7e3e611bb638 req-ac6a8478-b5cd-4c03-82d8-1dc56af55baa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6d9c29e-2804-48bd-b739-42f35d5d3112", "tag": "f4a884d8-f8ff-4efe-b295-42f90763da1e"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:44:40.734490 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-941a7557-9294-4458-948f-7934a4c72632 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:40.735261 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-941a7557-9294-4458-948f-7934a4c72632 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:40.739597 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-941a7557-9294-4458-948f-7934a4c72632 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:40.739597 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-941a7557-9294-4458-948f-7934a4c72632 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:40.739597 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-941a7557-9294-4458-948f-7934a4c72632 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:40.739597 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-941a7557-9294-4458-948f-7934a4c72632 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:40.740031 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-1021c40c-0ccb-48bf-acb6-7e3e611bb638 req-ac6a8478-b5cd-4c03-82d8-1dc56af55baa service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:40.740031 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-1021c40c-0ccb-48bf-acb6-7e3e611bb638 req-ac6a8478-b5cd-4c03-82d8-1dc56af55baa service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:40.740245 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-1021c40c-0ccb-48bf-acb6-7e3e611bb638 req-ac6a8478-b5cd-4c03-82d8-1dc56af55baa service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:40.754067 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-1021c40c-0ccb-48bf-acb6-7e3e611bb638 req-ac6a8478-b5cd-4c03-82d8-1dc56af55baa service nova] Creating event network-changed:f4a884d8-f8ff-4efe-b295-42f90763da1e for instance f6d9c29e-2804-48bd-b739-42f35d5d3112 on hv-cinder-83124 Aug 19 16:44:40.759180 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-1021c40c-0ccb-48bf-acb6-7e3e611bb638 req-ac6a8478-b5cd-4c03-82d8-1dc56af55baa service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034743 Aug 19 16:44:40.760029 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 643/1288] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 16:44:40.766886 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-941a7557-9294-4458-948f-7934a4c72632 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Going to try to terminate instance {{(pid=127284) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:44:40.854959 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-941a7557-9294-4458-948f-7934a4c72632 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "DELETE /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 204 len: 0 microversion: 2.1 time: 0.132153 Aug 19 16:44:40.855631 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 646/1289] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:44:40 2022] DELETE /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:44:40.864572 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-2b80d669-b368-46fb-b196-ff384d8d7fed tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:40.865320 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-2b80d669-b368-46fb-b196-ff384d8d7fed tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:40.871664 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2b80d669-b368-46fb-b196-ff384d8d7fed tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:40.872146 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2b80d669-b368-46fb-b196-ff384d8d7fed tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:40.872575 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2b80d669-b368-46fb-b196-ff384d8d7fed tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:40.873293 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2b80d669-b368-46fb-b196-ff384d8d7fed tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:40.873739 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2b80d669-b368-46fb-b196-ff384d8d7fed tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:40.874158 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-2b80d669-b368-46fb-b196-ff384d8d7fed tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:41.042766 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-2b80d669-b368-46fb-b196-ff384d8d7fed tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:41.050537 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-2b80d669-b368-46fb-b196-ff384d8d7fed tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1578 microversion: 2.1 time: 0.190084 Aug 19 16:44:41.051462 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 644/1290] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:40 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1578 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:42.072330 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-e57e08a6-b130-4910-941d-78a72edf3a20 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:42.073048 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-e57e08a6-b130-4910-941d-78a72edf3a20 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:42.079757 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e57e08a6-b130-4910-941d-78a72edf3a20 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:42.080228 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e57e08a6-b130-4910-941d-78a72edf3a20 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:42.080666 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e57e08a6-b130-4910-941d-78a72edf3a20 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:42.081472 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e57e08a6-b130-4910-941d-78a72edf3a20 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:42.081919 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e57e08a6-b130-4910-941d-78a72edf3a20 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:42.082342 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-e57e08a6-b130-4910-941d-78a72edf3a20 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:42.218269 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-e57e08a6-b130-4910-941d-78a72edf3a20 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:42.226072 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-e57e08a6-b130-4910-941d-78a72edf3a20 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1578 microversion: 2.1 time: 0.157948 Aug 19 16:44:42.226704 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 647/1291] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:42 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:43.247579 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-f262ae38-2d0b-47dd-98e4-6355dde7f7d9 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:43.248221 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-f262ae38-2d0b-47dd-98e4-6355dde7f7d9 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:43.254684 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f262ae38-2d0b-47dd-98e4-6355dde7f7d9 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:43.255278 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f262ae38-2d0b-47dd-98e4-6355dde7f7d9 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:43.255627 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f262ae38-2d0b-47dd-98e4-6355dde7f7d9 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:43.256326 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f262ae38-2d0b-47dd-98e4-6355dde7f7d9 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:43.256788 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f262ae38-2d0b-47dd-98e4-6355dde7f7d9 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:43.257217 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-f262ae38-2d0b-47dd-98e4-6355dde7f7d9 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:43.274918 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [req-f9d60a58-67b4-4f4f-885f-9b3696ade122 req-75d9f12f-598e-4baf-9d24-f3f0c7aa996c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d9c29e-2804-48bd-b739-42f35d5d3112", "name": "network-vif-deleted", "tag": "f4a884d8-f8ff-4efe-b295-42f90763da1e"}]} {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:44:43.289070 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-f9d60a58-67b4-4f4f-885f-9b3696ade122 req-75d9f12f-598e-4baf-9d24-f3f0c7aa996c service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:43.289790 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-f9d60a58-67b4-4f4f-885f-9b3696ade122 req-75d9f12f-598e-4baf-9d24-f3f0c7aa996c service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:43.290350 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [req-f9d60a58-67b4-4f4f-885f-9b3696ade122 req-75d9f12f-598e-4baf-9d24-f3f0c7aa996c service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:43.307189 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.compute.server_external_events [req-f9d60a58-67b4-4f4f-885f-9b3696ade122 req-75d9f12f-598e-4baf-9d24-f3f0c7aa996c service nova] Creating event network-vif-deleted:f4a884d8-f8ff-4efe-b295-42f90763da1e for instance f6d9c29e-2804-48bd-b739-42f35d5d3112 on hv-cinder-83124 Aug 19 16:44:43.314426 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [req-f9d60a58-67b4-4f4f-885f-9b3696ade122 req-75d9f12f-598e-4baf-9d24-f3f0c7aa996c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048118 Aug 19 16:44:43.315203 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 648/1292] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:44:43.324416 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-f262ae38-2d0b-47dd-98e4-6355dde7f7d9 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f989b6fded53458b85b39789a32a39e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5181e8549b3a439c8921319d6957f670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:44:43.332770 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-f262ae38-2d0b-47dd-98e4-6355dde7f7d9 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 200 len: 1392 microversion: 2.1 time: 0.089239 Aug 19 16:44:43.333388 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 645/1293] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:43 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 1392 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:44:44.355489 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-01e17b5e-3cf5-456d-802d-21f9d6586d0d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:44.356175 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-01e17b5e-3cf5-456d-802d-21f9d6586d0d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: f6d9c29e-2804-48bd-b739-42f35d5d3112] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:44.362894 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-01e17b5e-3cf5-456d-802d-21f9d6586d0d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:44.363385 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-01e17b5e-3cf5-456d-802d-21f9d6586d0d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:44.363823 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-01e17b5e-3cf5-456d-802d-21f9d6586d0d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:44.364508 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-01e17b5e-3cf5-456d-802d-21f9d6586d0d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:44.364994 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-01e17b5e-3cf5-456d-802d-21f9d6586d0d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:44.365421 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-01e17b5e-3cf5-456d-802d-21f9d6586d0d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:44.379301 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-01e17b5e-3cf5-456d-802d-21f9d6586d0d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] HTTP exception thrown: Instance f6d9c29e-2804-48bd-b739-42f35d5d3112 could not be found. Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-01e17b5e-3cf5-456d-802d-21f9d6586d0d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Request method failure captured: Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 HTTP/1.1 Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7wwtaTPS4yhEMKX53xcC7hL62iip6pDRARiMrXKgIHc7CY848PNsJg1aSVdSjM5SD_z3fgBhz_mquV2-kYy_8uXoMWXhLsg9HRfkUwFsduJc4-aBd2DS7iN9bYmJzu-APLqRRI_lEHrhR-PflScv1JC-2oA2p5kwrfuzd0dYkyYGkc Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: 5181e8549b3a439c8921319d6957f670 Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-TestVolumeBootPattern-760970128 Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:44:44.380932 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:44:44.382710 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5181e8549b3a439c8921319d6957f670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5181e8549b3a439c8921319d6957f670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5181e8549b3a439c8921319d6957f670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5181e8549b3a439c8921319d6957f670"}]}] Aug 19 16:44:44.382710 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-TestVolumeBootPattern-760970128 Aug 19 16:44:44.382710 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: 5181e8549b3a439c8921319d6957f670 Aug 19 16:44:44.382710 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-TestVolumeBootPattern-760970128 Aug 19 16:44:44.382710 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-TestVolumeBootPattern-760970128-project Aug 19 16:44:44.382710 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:44:44.382710 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:44:44.382710 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: f989b6fded53458b85b39789a32a39e4 Aug 19 16:44:44.382710 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-TestVolumeBootPattern-760970128-project Aug 19 16:44:44.382710 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:44:44.382710 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance f6d9c29e-2804-48bd-b739-42f35d5d3112 could not be found. Aug 19 16:44:44.382710 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': 'f6d9c29e-2804-48bd-b739-42f35d5d3112'} Aug 19 16:44:44.383652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:44:44.383652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:44:44.383652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:44:44.383652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:44:44.383652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:44:44.383652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:44:44.383652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:44:44.383652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:44:44.383652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:44:44.383652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:44:44.383652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6d9c29e-2804-48bd-b739-42f35d5d3112 could not be found. Aug 19 16:44:44.383652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:44:44.383652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:44:44.383652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:44:44.383652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:44:44.383652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:44:44.383652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:44:44.383652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:44:44.383652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:44:44.383652 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:44:44.385294 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:44:44.385294 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:44:44.385294 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:44:44.385294 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:44:44.385294 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:44:44.385294 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:44:44.385294 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:44:44.385294 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6d9c29e-2804-48bd-b739-42f35d5d3112 could not be found. Aug 19 16:44:44.385294 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:44:44.385294 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:44:44.385294 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:44:44.385294 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:44:44.385294 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:44:44.385294 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:44:44.385294 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:44:44.385294 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:44:44.385294 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6d9c29e-2804-48bd-b739-42f35d5d3112 could not be found. Aug 19 16:44:44.385294 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:44:44.386709 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-01e17b5e-3cf5-456d-802d-21f9d6586d0d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Returning 404 to user: Instance f6d9c29e-2804-48bd-b739-42f35d5d3112 could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:44:44.386709 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-01e17b5e-3cf5-456d-802d-21f9d6586d0d tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112" status: 404 len: 111 microversion: 2.1 time: 0.031410 Aug 19 16:44:44.386709 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 649/1294] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:44 2022] GET /compute/v2.1/servers/f6d9c29e-2804-48bd-b739-42f35d5d3112 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:44:45.052930 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3783ae03-b115-4d7e-ac9b-6ae4977ed34c tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:45.053443 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-3783ae03-b115-4d7e-ac9b-6ae4977ed34c tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:45.060404 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3783ae03-b115-4d7e-ac9b-6ae4977ed34c tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:45.060987 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3783ae03-b115-4d7e-ac9b-6ae4977ed34c tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:45.061428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3783ae03-b115-4d7e-ac9b-6ae4977ed34c tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:45.062113 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3783ae03-b115-4d7e-ac9b-6ae4977ed34c tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:45.062567 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3783ae03-b115-4d7e-ac9b-6ae4977ed34c tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:45.062991 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-3783ae03-b115-4d7e-ac9b-6ae4977ed34c tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:45.076782 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-3783ae03-b115-4d7e-ac9b-6ae4977ed34c tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] HTTP exception thrown: Instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f could not be found. Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3783ae03-b115-4d7e-ac9b-6ae4977ed34c tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Request method failure captured: Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: DELETE /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f HTTP/1.1 Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_7wwtaTPS4yhEMKX53xcC7hL62iip6pDRARiMrXKgIHc7CY848PNsJg1aSVdSjM5SD_z3fgBhz_mquV2-kYy_8uXoMWXhLsg9HRfkUwFsduJc4-aBd2DS7iN9bYmJzu-APLqRRI_lEHrhR-PflScv1JC-2oA2p5kwrfuzd0dYkyYGkc Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: 5181e8549b3a439c8921319d6957f670 Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-TestVolumeBootPattern-760970128 Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:44:45.078424 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:44:45.080135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5181e8549b3a439c8921319d6957f670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5181e8549b3a439c8921319d6957f670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5181e8549b3a439c8921319d6957f670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5181e8549b3a439c8921319d6957f670"}]}] Aug 19 16:44:45.080135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-TestVolumeBootPattern-760970128 Aug 19 16:44:45.080135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: 5181e8549b3a439c8921319d6957f670 Aug 19 16:44:45.080135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-TestVolumeBootPattern-760970128 Aug 19 16:44:45.080135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-TestVolumeBootPattern-760970128-project Aug 19 16:44:45.080135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:44:45.080135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:44:45.080135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: f989b6fded53458b85b39789a32a39e4 Aug 19 16:44:45.080135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-TestVolumeBootPattern-760970128-project Aug 19 16:44:45.080135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:44:45.080135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f could not be found. Aug 19 16:44:45.080135 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': '6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f'} Aug 19 16:44:45.081156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:44:45.081156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:44:45.081156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:44:45.081156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:44:45.081156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:44:45.081156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:44:45.081156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:44:45.081156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:44:45.081156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:44:45.081156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:44:45.081156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f could not be found. Aug 19 16:44:45.081156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:44:45.081156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:44:45.081156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:44:45.081156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:44:45.081156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:44:45.081156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:44:45.081156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:44:45.081156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:44:45.081156 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:44:45.082946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:44:45.082946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 19 16:44:45.082946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 19 16:44:45.082946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 19 16:44:45.082946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 19 16:44:45.082946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:44:45.082946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:44:45.082946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:44:45.082946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:44:45.082946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f could not be found. Aug 19 16:44:45.082946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:44:45.082946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:44:45.082946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:44:45.082946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:44:45.082946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:44:45.082946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:44:45.082946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:44:45.082946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:44:45.082946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f could not be found. Aug 19 16:44:45.082946 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:44:45.084678 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-3783ae03-b115-4d7e-ac9b-6ae4977ed34c tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Returning 404 to user: Instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:44:45.084678 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-3783ae03-b115-4d7e-ac9b-6ae4977ed34c tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 404 len: 111 microversion: 2.1 time: 0.030758 Aug 19 16:44:45.084678 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 646/1295] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:44:45 2022] DELETE /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:44:45.088275 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ea4b9801-fecc-4e2b-aaff-30a1713768d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:45.088898 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ea4b9801-fecc-4e2b-aaff-30a1713768d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] [instance: 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:44:45.095127 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea4b9801-fecc-4e2b-aaff-30a1713768d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:45.095608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea4b9801-fecc-4e2b-aaff-30a1713768d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:45.096037 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea4b9801-fecc-4e2b-aaff-30a1713768d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:45.096795 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea4b9801-fecc-4e2b-aaff-30a1713768d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:44:45.097187 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea4b9801-fecc-4e2b-aaff-30a1713768d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:44:45.097608 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ea4b9801-fecc-4e2b-aaff-30a1713768d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:44:45.110710 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.wsgi [None req-ea4b9801-fecc-4e2b-aaff-30a1713768d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] HTTP exception thrown: Instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f could not be found. Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ea4b9801-fecc-4e2b-aaff-30a1713768d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Request method failure captured: Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: request: GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f HTTP/1.1 Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept: application/json Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Accept-Encoding: identity Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Connection: close Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Length: 0 Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Content-Type: application/json Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Host: 10.222.0.55 Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Openstack-System-Scope: None Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: User-Agent: python-urllib3/1.26.11 Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Auth-Token: gAAAAABi_7wwtaTPS4yhEMKX53xcC7hL62iip6pDRARiMrXKgIHc7CY848PNsJg1aSVdSjM5SD_z3fgBhz_mquV2-kYy_8uXoMWXhLsg9HRfkUwFsduJc4-aBd2DS7iN9bYmJzu-APLqRRI_lEHrhR-PflScv1JC-2oA2p5kwrfuzd0dYkyYGkc Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Id: None Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Domain-Name: None Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Identity-Status: Confirmed Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Is-Admin-Project: True Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Id: default Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Domain-Name: Default Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Id: 5181e8549b3a439c8921319d6957f670 Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Project-Name: tempest-TestVolumeBootPattern-760970128 Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Role: member,reader Aug 19 16:44:45.112210 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Roles: member,reader Aug 19 16:44:45.113900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5181e8549b3a439c8921319d6957f670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5181e8549b3a439c8921319d6957f670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5181e8549b3a439c8921319d6957f670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5181e8549b3a439c8921319d6957f670"}]}] Aug 19 16:44:45.113900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant: tempest-TestVolumeBootPattern-760970128 Aug 19 16:44:45.113900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Id: 5181e8549b3a439c8921319d6957f670 Aug 19 16:44:45.113900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-Tenant-Name: tempest-TestVolumeBootPattern-760970128 Aug 19 16:44:45.113900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User: tempest-TestVolumeBootPattern-760970128-project Aug 19 16:44:45.113900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Id: default Aug 19 16:44:45.113900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Domain-Name: Default Aug 19 16:44:45.113900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Id: f989b6fded53458b85b39789a32a39e4 Aug 19 16:44:45.113900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: X-User-Name: tempest-TestVolumeBootPattern-760970128-project Aug 19 16:44:45.113900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: method: > Aug 19 16:44:45.113900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: exception: Instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f could not be found. Aug 19 16:44:45.113900 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: action_args: {'id': '6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f'} Aug 19 16:44:45.115089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:44:45.115089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:44:45.115089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:44:45.115089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:44:45.115089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:44:45.115089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:44:45.115089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:44:45.115089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:44:45.115089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:44:45.115089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:44:45.115089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f could not be found. Aug 19 16:44:45.115089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:44:45.115089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:44:45.115089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:44:45.115089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:44:45.115089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:44:45.115089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:44:45.115089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:44:45.115089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:44:45.115089 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:44:45.116678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:44:45.116678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:44:45.116678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:44:45.116678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:44:45.116678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:44:45.116678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:44:45.116678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:44:45.116678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f could not be found. Aug 19 16:44:45.116678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:44:45.116678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:44:45.116678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:44:45.116678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:44:45.116678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:44:45.116678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:44:45.116678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:44:45.116678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:44:45.116678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f could not be found. Aug 19 16:44:45.116678 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: ERROR nova.api.openstack.wsgi Aug 19 16:44:45.118486 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ea4b9801-fecc-4e2b-aaff-30a1713768d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Returning 404 to user: Instance 6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f could not be found. {{(pid=127284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:44:45.118486 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ea4b9801-fecc-4e2b-aaff-30a1713768d8 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f" status: 404 len: 111 microversion: 2.1 time: 0.029087 Aug 19 16:44:45.118486 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 650/1296] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:44:45 2022] GET /compute/v2.1/servers/6fae9fdd-d73f-46ed-b2c1-1f2d6f47e62f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:44:46.407301 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-abbfe40f-76a1-4624-b6ac-a04f2d626614 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] Calling method '.version_select at 0x7fb0228ee940>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:44:46.432303 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-abbfe40f-76a1-4624-b6ac-a04f2d626614 tempest-TestVolumeBootPattern-760970128 tempest-TestVolumeBootPattern-760970128-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-160800237" status: 202 len: 0 microversion: 2.1 time: 0.028752 Aug 19 16:44:46.433841 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 647/1297] 10.222.0.55 () {58 vars in 1260 bytes} [Fri Aug 19 16:44:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-160800237 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:45:48.567358 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=2 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:45:48.571822 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_cell1:SELECT=34 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:45:48.572568 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG dbcounter [-] [127285] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=127285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:45:48.573802 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG dbcounter [-] [127284] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:45:48.580793 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-ef40d1d7-7d1a-4ede-8eeb-3829cc119c08 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:45:48.581295 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-8c7090cd-f75d-4247-9f42-92df82712c9d req-30cc1479-bde2-473e-a1ad-6fab19c2f4ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aa33ae3-4967-490a-9f6c-81e8d4281a0f", "tag": "a73aa2cc-c181-4f88-a281-4452334ab294"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:45:48.581467 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ef40d1d7-7d1a-4ede-8eeb-3829cc119c08 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:45:48.589378 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ef40d1d7-7d1a-4ede-8eeb-3829cc119c08 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:45:48.589863 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ef40d1d7-7d1a-4ede-8eeb-3829cc119c08 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:45:48.590301 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ef40d1d7-7d1a-4ede-8eeb-3829cc119c08 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:45:48.591131 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ef40d1d7-7d1a-4ede-8eeb-3829cc119c08 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:45:48.591707 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ef40d1d7-7d1a-4ede-8eeb-3829cc119c08 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:45:48.592180 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-ef40d1d7-7d1a-4ede-8eeb-3829cc119c08 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:45:48.592704 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-8c7090cd-f75d-4247-9f42-92df82712c9d req-30cc1479-bde2-473e-a1ad-6fab19c2f4ec service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:45:48.593237 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-8c7090cd-f75d-4247-9f42-92df82712c9d req-30cc1479-bde2-473e-a1ad-6fab19c2f4ec service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:45:48.593665 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-8c7090cd-f75d-4247-9f42-92df82712c9d req-30cc1479-bde2-473e-a1ad-6fab19c2f4ec service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:45:48.604571 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-8c7090cd-f75d-4247-9f42-92df82712c9d req-30cc1479-bde2-473e-a1ad-6fab19c2f4ec service nova] Creating event network-changed:a73aa2cc-c181-4f88-a281-4452334ab294 for instance 8aa33ae3-4967-490a-9f6c-81e8d4281a0f on hv-cinder-83124 Aug 19 16:45:48.609755 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-8c7090cd-f75d-4247-9f42-92df82712c9d req-30cc1479-bde2-473e-a1ad-6fab19c2f4ec service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039945 Aug 19 16:45:48.610715 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 648/1298] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:45:48.623223 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-ef40d1d7-7d1a-4ede-8eeb-3829cc119c08 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Going to try to terminate instance {{(pid=127284) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 19 16:45:48.710580 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-ef40d1d7-7d1a-4ede-8eeb-3829cc119c08 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 204 len: 0 microversion: 2.1 time: 0.145301 Aug 19 16:45:48.714470 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 651/1299] 10.222.0.55 () {58 vars in 1239 bytes} [Fri Aug 19 16:45:48 2022] DELETE /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 16:45:48.720646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-19303514-c3e9-4fe0-a04c-36d56498cc7f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:45:48.721406 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-19303514-c3e9-4fe0-a04c-36d56498cc7f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:45:48.733231 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-19303514-c3e9-4fe0-a04c-36d56498cc7f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:45:48.733722 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-19303514-c3e9-4fe0-a04c-36d56498cc7f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:45:48.734159 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-19303514-c3e9-4fe0-a04c-36d56498cc7f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:45:48.734866 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-19303514-c3e9-4fe0-a04c-36d56498cc7f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:45:48.735319 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-19303514-c3e9-4fe0-a04c-36d56498cc7f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:45:48.735789 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-19303514-c3e9-4fe0-a04c-36d56498cc7f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:45:48.874950 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.policy [None req-19303514-c3e9-4fe0-a04c-36d56498cc7f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127285) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:45:48.883834 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-19303514-c3e9-4fe0-a04c-36d56498cc7f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1567 microversion: 2.1 time: 0.168024 Aug 19 16:45:48.884408 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 649/1300] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:45:48 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:45:49.907019 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-725f6510-0112-440f-a887-70167c1e3881 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:45:49.907644 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-725f6510-0112-440f-a887-70167c1e3881 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:45:49.914216 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-725f6510-0112-440f-a887-70167c1e3881 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:45:49.914696 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-725f6510-0112-440f-a887-70167c1e3881 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:45:49.915130 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-725f6510-0112-440f-a887-70167c1e3881 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:45:49.915820 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-725f6510-0112-440f-a887-70167c1e3881 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:45:49.916270 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-725f6510-0112-440f-a887-70167c1e3881 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:45:49.916706 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-725f6510-0112-440f-a887-70167c1e3881 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:45:50.077379 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-725f6510-0112-440f-a887-70167c1e3881 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:45:50.085376 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-725f6510-0112-440f-a887-70167c1e3881 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1567 microversion: 2.1 time: 0.183548 Aug 19 16:45:50.085935 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 652/1301] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:45:49 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 16:45:51.003545 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [req-820259f5-3f98-47bb-a6f7-7bcb962f0f88 req-abe07e17-7868-49a9-885e-0fdb2482e954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aa33ae3-4967-490a-9f6c-81e8d4281a0f", "name": "network-vif-deleted", "tag": "a73aa2cc-c181-4f88-a281-4452334ab294"}]} {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 16:45:51.013714 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-820259f5-3f98-47bb-a6f7-7bcb962f0f88 req-abe07e17-7868-49a9-885e-0fdb2482e954 service nova] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:45:51.014189 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-820259f5-3f98-47bb-a6f7-7bcb962f0f88 req-abe07e17-7868-49a9-885e-0fdb2482e954 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:45:51.014616 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [req-820259f5-3f98-47bb-a6f7-7bcb962f0f88 req-abe07e17-7868-49a9-885e-0fdb2482e954 service nova] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:45:51.026876 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.compute.server_external_events [req-820259f5-3f98-47bb-a6f7-7bcb962f0f88 req-abe07e17-7868-49a9-885e-0fdb2482e954 service nova] Creating event network-vif-deleted:a73aa2cc-c181-4f88-a281-4452334ab294 for instance 8aa33ae3-4967-490a-9f6c-81e8d4281a0f on hv-cinder-83124 Aug 19 16:45:51.031664 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [req-820259f5-3f98-47bb-a6f7-7bcb962f0f88 req-abe07e17-7868-49a9-885e-0fdb2482e954 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031706 Aug 19 16:45:51.032298 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 650/1302] 10.222.0.55 () {64 vars in 1317 bytes} [Fri Aug 19 16:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 16:45:51.106058 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-6ae6a1b0-7a0f-4726-94ed-c40ea02e5b1f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:45:51.106672 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.compute.api [None req-6ae6a1b0-7a0f-4726-94ed-c40ea02e5b1f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127284) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:45:51.113223 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6ae6a1b0-7a0f-4726-94ed-c40ea02e5b1f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:45:51.113701 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6ae6a1b0-7a0f-4726-94ed-c40ea02e5b1f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:45:51.114138 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6ae6a1b0-7a0f-4726-94ed-c40ea02e5b1f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:45:51.114886 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6ae6a1b0-7a0f-4726-94ed-c40ea02e5b1f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:45:51.115433 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6ae6a1b0-7a0f-4726-94ed-c40ea02e5b1f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:45:51.115863 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG oslo_concurrency.lockutils [None req-6ae6a1b0-7a0f-4726-94ed-c40ea02e5b1f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:45:51.178369 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.policy [None req-6ae6a1b0-7a0f-4726-94ed-c40ea02e5b1f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886a581760e547b6a15856da84ef3859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363667c09d4e481da5767f1043d57e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127284) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 16:45:51.186077 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-6ae6a1b0-7a0f-4726-94ed-c40ea02e5b1f tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 200 len: 1219 microversion: 2.1 time: 0.083880 Aug 19 16:45:51.186629 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 653/1303] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:45:51 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 16:45:52.209567 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d2475d26-ad8e-40d1-b463-713975cb1677 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '>' {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:45:52.211129 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.compute.api [None req-d2475d26-ad8e-40d1-b463-713975cb1677 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] [instance: 8aa33ae3-4967-490a-9f6c-81e8d4281a0f] Fetching instance by UUID {{(pid=127285) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 19 16:45:52.217231 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2475d26-ad8e-40d1-b463-713975cb1677 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:45:52.217729 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2475d26-ad8e-40d1-b463-713975cb1677 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:45:52.218155 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2475d26-ad8e-40d1-b463-713975cb1677 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:45:52.218843 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2475d26-ad8e-40d1-b463-713975cb1677 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Acquiring lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 19 16:45:52.219307 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2475d26-ad8e-40d1-b463-713975cb1677 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 19 16:45:52.219760 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG oslo_concurrency.lockutils [None req-d2475d26-ad8e-40d1-b463-713975cb1677 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Lock "2a0d5d8f-71c0-44b5-bd37-1becf3ff3d30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 19 16:45:52.235109 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.wsgi [None req-d2475d26-ad8e-40d1-b463-713975cb1677 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] HTTP exception thrown: Instance 8aa33ae3-4967-490a-9f6c-81e8d4281a0f could not be found. Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d2475d26-ad8e-40d1-b463-713975cb1677 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Request method failure captured: Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: request: GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f HTTP/1.1 Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept: application/json Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Accept-Encoding: identity Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Connection: close Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Length: 0 Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Content-Type: application/json Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Host: 10.222.0.55 Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Openstack-System-Scope: None Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: User-Agent: python-urllib3/1.26.11 Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Auth-Token: gAAAAABi_70o_Alfr1VTXbTbsOIFUyYCFh8jat9PpF_7WBV0ty7xfL5_4ysaaqRLiGUl3ohnTb2_9-npcjFx8PlchT11bq6g_JClNhWnMOPXh67FOIMehMq8Wh8she5MQ6wIQs3sPbQMtkY7si5AtvZfZkTK7ijF3Q4JFFUwJ2GvDNSK4pmya0I Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Id: None Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Domain-Name: None Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Identity-Status: Confirmed Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Is-Admin-Project: True Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Id: default Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Domain-Name: Default Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Id: 363667c09d4e481da5767f1043d57e76 Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Project-Name: tempest-TestShelveInstance-1203678070 Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Role: member,reader Aug 19 16:45:52.236743 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Roles: member,reader Aug 19 16:45:52.238586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_363667c09d4e481da5767f1043d57e76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/363667c09d4e481da5767f1043d57e76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/363667c09d4e481da5767f1043d57e76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/363667c09d4e481da5767f1043d57e76"}]}] Aug 19 16:45:52.238586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant: tempest-TestShelveInstance-1203678070 Aug 19 16:45:52.238586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Id: 363667c09d4e481da5767f1043d57e76 Aug 19 16:45:52.238586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-Tenant-Name: tempest-TestShelveInstance-1203678070 Aug 19 16:45:52.238586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User: tempest-TestShelveInstance-1203678070-project Aug 19 16:45:52.238586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Id: default Aug 19 16:45:52.238586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Domain-Name: Default Aug 19 16:45:52.238586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Id: 886a581760e547b6a15856da84ef3859 Aug 19 16:45:52.238586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: X-User-Name: tempest-TestShelveInstance-1203678070-project Aug 19 16:45:52.238586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: method: > Aug 19 16:45:52.238586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: exception: Instance 8aa33ae3-4967-490a-9f6c-81e8d4281a0f could not be found. Aug 19 16:45:52.238586 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: action_args: {'id': '8aa33ae3-4967-490a-9f6c-81e8d4281a0f'} Aug 19 16:45:52.239646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: {{(pid=127285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 19 16:45:52.239646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:45:52.239646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 19 16:45:52.239646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 19 16:45:52.239646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 19 16:45:52.239646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 19 16:45:52.239646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 19 16:45:52.239646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 19 16:45:52.239646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 19 16:45:52.239646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 19 16:45:52.239646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8aa33ae3-4967-490a-9f6c-81e8d4281a0f could not be found. Aug 19 16:45:52.239646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:45:52.239646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:45:52.239646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:45:52.239646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:45:52.239646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:45:52.239646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:45:52.239646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 19 16:45:52.239646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 19 16:45:52.239646 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 19 16:45:52.241428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 19 16:45:52.241428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 19 16:45:52.241428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 19 16:45:52.241428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 19 16:45:52.241428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 19 16:45:52.241428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 19 16:45:52.241428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 19 16:45:52.241428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8aa33ae3-4967-490a-9f6c-81e8d4281a0f could not be found. Aug 19 16:45:52.241428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:45:52.241428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 19 16:45:52.241428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:45:52.241428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 19 16:45:52.241428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 19 16:45:52.241428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 19 16:45:52.241428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 19 16:45:52.241428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 19 16:45:52.241428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8aa33ae3-4967-490a-9f6c-81e8d4281a0f could not be found. Aug 19 16:45:52.241428 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: ERROR nova.api.openstack.wsgi Aug 19 16:45:52.243064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: DEBUG nova.api.openstack.wsgi [None req-d2475d26-ad8e-40d1-b463-713975cb1677 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Returning 404 to user: Instance 8aa33ae3-4967-490a-9f6c-81e8d4281a0f could not be found. {{(pid=127285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 19 16:45:52.243064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO nova.api.openstack.requestlog [None req-d2475d26-ad8e-40d1-b463-713975cb1677 tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f" status: 404 len: 111 microversion: 2.1 time: 0.034166 Aug 19 16:45:52.243064 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: [pid: 127285|app: 0|req: 651/1304] 10.222.0.55 () {58 vars in 1236 bytes} [Fri Aug 19 16:45:52 2022] GET /compute/v2.1/servers/8aa33ae3-4967-490a-9f6c-81e8d4281a0f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 16:45:52.398610 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: DEBUG nova.api.openstack.wsgi [None req-856395de-381a-4ddd-992a-c5e048ab7acd tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] Calling method '.version_select at 0x7fb01e1de700>' {{(pid=127284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 16:45:52.418761 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO nova.api.openstack.requestlog [None req-856395de-381a-4ddd-992a-c5e048ab7acd tempest-TestShelveInstance-1203678070 tempest-TestShelveInstance-1203678070-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1622513670" status: 202 len: 0 microversion: 2.1 time: 0.024570 Aug 19 16:45:52.419318 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: [pid: 127284|app: 0|req: 654/1305] 10.222.0.55 () {58 vars in 1254 bytes} [Fri Aug 19 16:45:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1622513670 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 16:47:02.309221 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 16:47:02.310392 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Fri Aug 19 16:47:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 16:47:06.289306 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 16:47:06.289939 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Fri Aug 19 16:47:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 16:48:37.394787 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 16:48:37.395336 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Fri Aug 19 16:48:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 16:48:44.733017 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 16:48:44.733564 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Fri Aug 19 16:48:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 16:50:22.318282 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 16:50:22.318923 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Fri Aug 19 16:50:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 16:50:26.297553 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 16:50:26.298260 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Fri Aug 19 16:50:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 16:50:51.927187 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 16:50:51.927715 dv-cinder-831247-23-iscsi devstack@n-api.service[127284]: Fri Aug 19 16:50:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 16:50:54.366730 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 16:50:54.367314 dv-cinder-831247-23-iscsi devstack@n-api.service[127285]: Fri Aug 19 16:50:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!